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SYSTEM, METHOD AND COMPUTER READABLE MEDIUM CONTAINING 
INSTRUCTIONS FOR EVALUATING AND DISSEMINATING SECUMTIES ANALYST 

PERFORMANCE INFORMATION 

5 RELATED APPLICATIONS 

This application claims priority from U.S. Provisional Application 60/196,314, filed April 12, 
2000, to Columbus et al.. which is incorporated herein by reference. 

10 TECHNICAL FIELD 

The present invention relates generally to analyzmg performance of investmi^t professionals, 
and more particularly, to a system, method, and computer readable medium storing computer- 
executable instructions for evaluating the p^ormance of securities analysts, investment analysts and/or 
15 other investment related individuals and/or entities. 

BACKGROUND ART 

In the context of securities and other types of investments, obtaining the advice of analysts has 
20 always been considered a prudent exercise. These analysts possess expertise in evaluating investments, 
such as securities, mutual funds, bonds, and the like. Most specialize in specific industries or sectors to 
allow for more in-depth research. During the course of providing investment advice, each analyst may 
make any number of upward and/or downward forecast revisions on securities in their area of expertise. 
These forecast revisions, or siix^)Iy revisions, are changes in opinion on how much a company is likely 
2S to earn per share. 

When these analysts speak, institutional as well as individual investors listen, driving stock 
prices sharply up or down d^nding on the nature of the analysts' latest pronouncements. As can be 
imagined, some analysts are more influential than others. For instance, some analysts, affectionately 

30 named 'axes', are so accurate that their comments carry disproportionate weight While none are 
infallible, it is inq>ortant to at least know and consider what professional analysts have to say about a 
particular stock of interest With access to this information, users can make their own assessments and 
invest accordingly. Accordingly, we have determined that a need exists for efticiently disseminating 
such analyst information to the public. A need also exists for a system, method, and conq>uter readable 

3S medium containing instructions utilizable for providing not only information concerning or considering 
an analyst's revisions, but also information pertaining to the reliability and/or accuracy of the revisions. 
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Several prior ait techniques have not adequately addressed these needs. For example, U.S. 
Patent 5,132,899 to Fox discloses a stock and cash portfolio development system. As depicted in prior 
art FIG, 1 of the present invention (FIG. 1 of Fox) , die system of ^x uses data gathering and 
processing methodology to produce a system where a list of stocks and a cash position is generated and 
5 purchased for investment and operating accounts. SpeciGcally, the system integrates three areas of 
data: investment p^ormance for investment managers; Federal Securities and Exchange Commission 
reports filed quarterly by investment managers; and financial characteristics for a number of stocks, to 
produce a stock portfolio. For exanqile, in box 1, investment managers are screened to produce a 
subset for analysis. From there, managers are selected (box 2) and sorted into descaiding order simply 
10 according to rates of retum on investments (box 3). Subsequendy, a consultant reviews the results (box 
4) and prints the top five mangers (box 5). 

Similady, U.S. Patent 4,566,066 to Towers relates to a securities valuation system. As shown 
in prior art HG. 2 of the present application (FIG. 1 of Towers) , the system of Towcts . conqmsed of 
components 10-23, produces securities portfolio valuation schedules for multiple simultaneous users. 
15 In TowCTs. a customer communicates with the system through terminal 10 to access and edit accounts 
in user file 12. By using a CUSIP routine 18 and an AMOUNT routine to reflect stock splits and 
dividends since the last stock pricing, the system of Towers produces and displays 23 a selected stock 
portfolio valuadon. 

20 In U.S. Patent 5,8 12,987 to T^slrin at al,, an investment fund management system manages 

ass^ in one or more investment funds over a specified period of time. This system, conqrzised of 
components 31-39, detramines a strategic investment mix of assets in a particular fund periodically as a 
function of changing risk. Each fund is managed by manipulating the investment mix of the fund in 
accordance with criteria related to a diminishing length of time to a horizon where cash will be 

25 withdrawn therefrom. In prior art HG. 3 of the present invention (FIG. 6 of Luskin et al.) . the 

investment mix is adjusted by first obtaining investor portfolio information 35 and market data 36. Iliis 
data is used to forecast market risks and returns 37, and to det^mine the portfolio risk 38. Then, the 
anticq)ated cash flow stream 39, the discount function 34, and present value of future cash flow 33 are 
calculated before producing an optimized portfolio 32 of assets. 

30 

In U.S. Patent 5,761,442 to Barr et al.. a data processing system selects securities and 
constructs an investment portfolio based on a set of artificial neural networks (prior art FIG. 4 of the 
present application, FIG. 2 of Barret al.\ The system conq>rises components 41-70 and is designed to 
model and track the performance of each security in a given capital market and output a parameter 
35 which is related to the expected risk adjusted retum for the security. Each artificial neural network is 
trained using a number of fundamental and price and volume history input parameters 10, 20, 30 about 
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the security and the underlymg index. The system combines the expected retum/appreciation potential 

data 50 for each security via an optiniization process 60 to construct an mvestment poxtfolio which 

satisfies aggregate statistics. The data processing systenoi receives iiqput from the capital market and 

periodically evaluates the performance of the investment portfolio, rebalancing whenever necessary to 

correct paf ormance degradations 70. 

However while many of these prior art references disclose adequate methods of managing 
investment funds and portfolios, none make any mention of evaluating an analyst's or other investment 
-trader's performance. H^ce, what is lacking in the prior art is a technique directed not only toward an 
investment fund, but rather a technique for evaluating analysts and other traders or investment 
professionals/advisors based on theur influence and accuracy. Accordingly, a need exists for a system^ 
method, and con^uter readable medium containing instructions utilizable for not only disseminating 
information concerning an analyses or trader's actions, but also for evaluating the analyst's or trader's 
performance. 

In line with the above, a need exists for a system, method, and computer readable medium 
containing instmctions utilizable not only for providing raw information and data but also for 
evaluating performance based on returns obs^ved after a particular revision, historical consistency, 
and/or the number of revisions made by the analyst or investing entity. 

Furthermore, a need exists for a system, noethod, and conq)Uter readable medium containing 
instructions utilizable for considering performance based on revisions including a change in opinion 
including an upward or downward change in opinion of the analyst with regard to at least one 
investment 

A need also exists for a system, method, and computer readable medium containing instructions 
utilizable for adjusting a performance measure to accentuate a number of revisions issued by an analyst 

Yet another need exists for a system, method, and conq>uter readable medium containing 
instmctions utilizable for adjustmg a performance measure according to a return amount adjustment 
accentuating the measure according to aretum amount realized on an mvestment 

Still another need exists for a system, method, and computer readable medium containing 
instmctions utilizable for adjusting a performance measure according to a small retum penalty 
peiudizing an analyst for small returns. 
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It is a feature and an advantage of tbe present invention to provide a system, method, and 
con^uter readable medium containing instructions utilizable for not only disseminating information 
5 concraning an analyst's or trade's actions, but also for evaluating the analyst's or trader's perfomiance. 

It is another feature and advantage of the present invention to provide a system, method, and 
comqputer readable medium containing instructions utilizable not only for providing raw information 
and data but also for evaluating performance based on returns observed after a particular revision, 
10 historical consistency, and/or the number of revisions made by the analyst or investing entity. 

It is another feature and advantage of the present invention to provide a system, method, and 
coiiq>uter readable medium containing iostructions utilizable for considering performance based on 
revisions including a change in opinion including an upward or downward change in opinion of the 
IS analyst with regard to at least one investment 

It is another feature and advantage of the preset invmtion to provide a system, method, and 
conq>uter readable medium containing instructions utilizable for adjusting a performance measure to 
accentuate a number of revisions issued by an analyst 

20 It is another feature and advantage of the present invention to provide a system, method, and 

computer readable medium containing instructions utilizable for adjusting a performance measure 
according to a return amount adjustment accentuating the measure according to a retum amount 
realized on an investment 

25 It is another feature and advantage of the present invention to provide a system, method, and 

computer readable medium containing instructions utilizable for adjusting a performance measure 
according to a small return penalty penalizing an analyst for small returns. 

One embodiment of the present invention, particularly applicable to securities analysts, is now 
30 summarized. 
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System/Processiiig Description 

Using a proprietary calculation, analysts may be given a series of performance scores that rank them 
relative to (1) other analysts in the "universe" and (2) other analysts that make predictions about a 
S specific conq>any. A total of five scores may be produced for each analyst 

Analyst Buy Score - Represents the analyst's Buy Score for all companies he/she covers, relative to the 
Universe of Analysts 

Analyst SeD Score - Represents the analysts SeU Score for all compames he/she covers, relative to the 
10 Universe of Analysts 

Analyst Company Buy Score - Represents the analyst's Score for a specific Conq>any 
Analyst Company Sell Score - Represents the analyst's Score for a specific Coixq>any 
Analyst Overall Score - Represents the analysts overall Score for all conq>anies that he/she covers 

15 AU scores will be calculated based on an event - the revision of an analyst's earnings forecast. 

Data Preparation Steps 

The following must be conq>lete before the Analyst calculations are begun: 

20 1. Analyst Backend [ABE] -4his process supplies the data firom any suitable data base for the 
calculations. 

2. ABB data relating to Brokers may be removed from the dB — in this embodiment we do not 
want to calculate Analyst scores for these non-analyst entities 

25 Analyst Scoring Logic 

The following logic will be used to calculate the scores for all analyst/conq>any combinations in the 
Analyst database with at least 2 earnings forecast revisions that are at least 60 days (3 calendar months) 
old. These raw scores will later be raziked to formulate the final Analyst scores: 

30 Raw Buy Analyst Score - Note, all inputs are based on calculated values related to earnings estimate 
revision changes 

For every analyst Jd and conq>any_id combination in the analyst_conq>any„total table with 2 or niore 
earnings estimate revisions^ calculate a raw scare using the following logic (the logic is first 
35 summarized and then explained in detail): 
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^tep 1 Calculate the average 5 day, 20 day and 60 day returns for eamings revisions [5/20/60 event 

returns] for each analyst/coiiq>any comhmation (done by ABE) 

Step 2 Calculate the t -statistic [t-stat] values for S/20/^ evrat returns in absolute terms 
Step 3 Calculate the degrees of freedom [DF] values for 5f20f60 event returns 
S Step 4 Look up probability value using DF and [t Stat] for S/20/60 event returns 
Step 5 Calculate raw score using conditional logic 
Step 6 Calculate adjustment to raw score 
Step 7 Calculate adjusted raw score 

Step 8 Calculate second adjustment to raw score and new raw score 
10 Step 9 Klimifiate raw scores with returns greater than 1000% 

Step 10 Sort and rank the raw scores to-produce the final Analyst Scores. 

For every analyst_id and conpany ^d combination in the analyst„coir^any_tc^ table in the Analyst 
dB with analyst_coiiq>any_totaI events 2, p^onn the following logic: 

15 



Stepl 

The 5 day, 20 day and 60 day return values are calculated by ABE for each analyst/conq)any 
combination: 

20 

Average 5day return = analyst_con:5)any_total.avg_5dy_jetunL.buy 
Average 20day return = analyst_coinpany_total.avg_20dy__retuni _buy 
Average 60day return =:analyst_coiiq>any_total.avg_60dy^tunijbuy 

25 Step 2 

The t-stat needs to be calculated in absolute terms (L€.,a non-negative nwnber) for the 5 day, 20 day 
and 60 day returns using the following formulas: 



The 5/20/60day_abs_tstat values may be rounded to 2 decimal places 

30 

Before beginning this calculation, we must ensure that we will not be dividing by zero. If the standard 
deviation is zero, then we will set the final raw score to zero and move to the next analyst/coizq>any 
combinatioiL 



35 



IF analyst_company_total.sd_5dy J)uy = 0, THEN raw.^care_biiy = 0 
And start over with the next analyst/conq)any buy combination 
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IF aiialyst_conq)any_total.sd_20dy„buy = 0, THEN raw_score_biiy = 0 
And start over with the next analyst/conq>any buy combmation 

5 IF aDaIyst„con:5)any_totaI.sd_60dy„buy = 0, THEN raw_scQre„buy = 0 
And start over with the next analyst/conqiany buy combination 



Sday _abs _tstat J}uy = 



analyst ^company _toialjayg _Sdy ^return _buy 



analyst ^company _totat^d _Sdy _buy 
^^analyst _company _ total Mum _5dy _event_buy ^ 



10 QMay _abs _tstat _buy = 



analyst ^company _totaljavg _ 20£fy _jrettam _huy 



analyst ^company _total^d J2My _huy ^ 
^^anaiyst ^company _totaljmm _2Xidy _event _buy ^ 



60day _abs _tstat _buy - 



analyst ^company _totaljavg _6My ^return _buy 



^ analyst ^company _total»sd _ 60rfy ^buy ^ 
^^analyst ^company _ total jium _60dy _event_buy j 



15 



20 



Step 3 



The degrees of fineedom are calculated by subtracting 1 firom the number of observations for each return 
value: 

5day _(^Jbuy = analyst jcompany_totalnum_5dy_eventJbuy-l 
20dayj^J)uy = analyst_conipany_totaLman_20dy_ev€ntJbuy-l 



60day_^J>uy — analyst_company_totaLmanjSOdy_eventJ}uy-l 



25 Step 4 
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For each return period, look up the probability using the absolute t-stat and DF for each respective 
calculation as inputs to a lookup table: 

IF 5/20/60day_df_buy > 100. THEN set 5/20/60day_dJLbuy = 100 

5 

IF 5/20/60„abs_tstatJ)uy > 20, THEN set 5/20/60day_abs_tstat.buy = 20 



IF 5y2Q/60day_abs tstat„buy < .01, THEN set 5y2Q/60day_jat>b_buy = 0 
10 5day_prob_buy = lookup value indicated by using 5day_abs tstat^buy and 5day_dO)uy 

20day_prob_.buy = lookup value indicated by using 20day_abs jtstat„bny and 20day_df J)uy 
60day_prob J)uy = looki^ value indicated by using 60day_abs_tstat jbuy and 60day„df Jjuy 

15 

Steps 

The conditional raw score may now be calculated. The conditional raw scare will be based on the 
average of the conditional raw scores for the 5 day period, 20 day period and for the 60 day period, 
which will then be multiplied by 100. The condition to determine whether the probability is added or 
20 subtracted is based on whether the average return is positive or negative, the formula is as foUows 
( cond _ raw _ score _ buy )* 



j ^[l-(5-t- 



or - 5day _ prob _ 6«y)] + [1 - (3 + or - TOday „ prob _ buy)] + [1 - (.5 + or - 60day _ prob _bi^)]\ 



♦10 



25 Logic: 



5 day portion of calculation 

BP anaIyst_company„total.avg_5dyjcetum^buy > 0 

THEN subtract 5day_prob_J>ny from .5 in numerator 

30 

- This next case means that we have a negative average return for the events and we may add the 
probability 



ELSE add 5day_prob__bny to .5 in numerator 

35 



wo 01780124 



PCT/USOl/11691 



9 

20day portion of calculation 

IF aiialystjconipany_totaLavg_20dy_jetum buy > 0 

THEN subtract 20day _prob_buy from .5 in numerator 



5 - This next case means that we have a negative average return for the events and we may add the 
probability 



ELSE add 20day_prob_bity to .5 in numerator 



10 60day portion ^^calculation 

IF analyst_conq)any_total.avg_60dy_jeturn_buy > 0 
THEN subtract 60day__probjbuy from .5 in numerator 



- This next case means that we have a negative average return for the events and we may add the 
15 probability 



ELSE add 60dayj)rob_buy to .5 in nun^rator 
Final step 

20 Take the average of the three calculated values above and multiply the result by 100 



Step 6 

Calculate the adjustment to the conditional raw score using the following formula (the adjustment is 
generally negative): 



25 



adj _ raw _buy- (-20) * 



jnim ^Sdy^evenis^buy-i- rum _20dy_events_buy'^nwn_€0dy ^events 
f 3 



- nuriL.5dy_events_buy, num 20dy_events_buy and num^20dy_eventsjbuy are taken from the 
analyst conapany„total table- 



30 



Note, the constant above may be changed for Analysts. 



Step? 

Calculate the raw score by adding the adjustnioit to the conditional raw score: 
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raw_scQreL_buy = (cand__raw__scQreL.buy) + (adj_raw„buy) 

- here we are adding a negative number (adj^raw.sell), therefore the adjustment should generally be 
5 negative— 

Step 8 

newjraw_scQre_buy = raw_scQre J)uy + (adj2_ raw_buy) 
10 Calculate second adjustment to raw_scoie_buy, variable name: adj2_raw_buy 
The adj2_raw_buy is conq}rised of the following 4 conq>onents: 

(1) 5 day returns portion ofcalculatkm 

15 IF analyst_con)pany_totaLavg_5dyjretum_buy> 10 
THEN 5day_adj23uy =10 

- This next case noeans that we have a 5 day return less or equal than 10(M)% and should use the 
following fotmula Note the formula is raised to the third power which is equivalent to the cube root — 

20 

ELSE 5day„adj2Jbuy = (100 * analyst_coir5)any_total.avg_5dy_xetumJ)uy)^ 

(2) 20 day returns portion of calculation 

IF analyst_conii)any_total.avg_20dyj:etumj)uy > 10 
25 THEN 20day_adj2_buy = 10 

- This next case means that we have a 20 day retum less than or equal 1000% and should use tte 
following formula. Note the fonnula is raised to the third power which is equivalent to the cube root — 

30 ELSE 20day_ adj2_buy = (100 * analyslL.company_total.avgJiOdy_jetunubuy)^ 

(3) 60 day returns portion of calculation 

IF analyst_conD5>any_total.avg_60dyretum _buy > 10 
THEN 60day_adj2_buy =10 

35 - This next case means that we have a 60 day retum less than or equal 1000% and should use the 

following formula. Note the formula is raised to the third power which is equivalent to the cube root - 
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■ - 1/3 

ELSE 60day_ adj2„buy = (100* aiudystjcoiDf)any_totaLavg_60dyj:etuniJbuy) 
(4) Small Returns penalty 

TP analyst_coiiq)any_total.avg_60dy_retiini_buy >0.15 
5 THEN small jcet_buy_adj = 0 

- This next case means that we positive letums less than or equal 15%, so we will impose a penalty on 
the iaw_bny-.scare — 

ELSE small_ret_buy_adj = (100* (0.15 - analyst_con)pany_total.avg_60dy.jetumj)uy)) 
Final step 

10 Combine the 4 components using the following fommla to anive at the final ad^jaw: 

adj2 jraw.buy = (5day_buy_adj2 / 3) + (20day_buy_adj2 / 3) + (60day_buy_adj2 / 3> 
smalLret_buy_adj 

Step9 

Final step is to eliminate returns ftom the final scoring that have 60 day returns greater than 1000% 

15 IF analyst_coDDpany_total.avg 60dyjretuni_buy > 10 
THEN filter this raw score in the final scoring process 

Step 10 

Analyst Scoring Log^c - Ranked (Final) Score 

The following ranking system will be used to determine the final scores for each of the analyst scores: 

20 Important Note: Only analyst that cover co^^>anies within the Analyst Universe should be given a final 
Analyst score in this example. 

Analyst Bay Score 

Once all of the raw scores have been calculated, we can then rank the raw buy scores by sorting the 
results in descending order and separate this list into 100 groups. The group with the highest set of 
25 scores will be given the ranking of 100 (signifying the best perfoimance), and the group with the lowest 
set of scores will be given the ranking of 1 (signifying the worst). The analysts in each group should 
then be assigned a score equal to the groiq) that they are in. 

Step 1 Develop list of analysts who have received a raw3uy-Score at conq)anies within the 

Analyst Universe 

30 Step 2 Count the number of analysts in the list created in Step 1 
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Step 3 Sort raw.scoie list descending for all analyst id/conopanyjid wh^ there is a score. 

[Note: If a secondary sort is needed, use analyst conq)any„total.avg.60day return descending]. 
Step 4 Use the look up table below to divide the ranked list into seven groiq>s, and then within 
each group divide the ranked raw-sc(»ne list into an equal number of observations for each score within 
5 the group (as defined in Table A shown below). 

Step 5 Record the score for the associated analyst^id and conq>any^d combinations in the group 

Raw SeU Analyst Score - Note, all inputs are based on calculated values related to earnings estimate 
revision changes 

10 

For every analyst id and conopany-id combination in the analyst conq>any total table with 2 or more 
earnings estimate revisions, calculate a raw score using the following logic (the logic is first 
sununarized and then e;q)lained in detail): 



IS Step 1 Calculate the average 6 day, 20 day and 60 day returns for earnings revisions [5/20/60 
event returns] for each analyst^company combination (done by ABE) 

Step 2 Calculate the t -statistic [t-stat] values for S/2Q/60 event returns in absolute terms 

Step 3 Calculate flie degrees of fieedom EDF] values for 5/20/60 event retums 

Step 4 Look up probability value using DF and [t-stat] for 5/20/60 event returns 

20 Step 5 Calculate raw score using conditional logic 

Step 6 Calculate adjustment to raw score 

Step 7 Calculate adjusted raw score 

Step 8 Calcidate second adjustment to raw score and new raw score 

Step 9 Eliminate raw scores with returns greater than 1000% 

25 Step 10 Sort and rank the raw scores to produce the final Analyst Sell Scores. 



In this exanq)le, for every analyst id and conq>any_id combination in the analyst_coixq)any_total table 
in the Analyst dB with analyst_conq>any_total.events >= 2 perform the following logic: 

30 Stepl 

The 5 day, 20 day and 60 day retum values are calculated by ABB for each analyst/conq)any 
combination. 

Average 5day retum = analyst_con5>any„total.avg_5dy_jretun\_sell 
35 Average 20day return = analyst_con[q>any_totaLavg_20dy_jetum_sell 
Average 60day return = analyst_company_totaLavg_60dy_jretum^sell 



I 
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Step 2 

The t-slat needs to be calculated in absolute terms (Le,, a non-negative number) for the 5 day, 20 day 
and 60 day returns using the following fonnulas: 

5 

The 5/20/60dayuabs_Utat values may be rounded to 2 decimal places 



Before beginning this calculation, we must ensure that we will not be dividing by zero. If the standard 
deviation is zero, then we will set the final raw score to zero and move to the next analyst/con^any 
10 combination. 



IF analyst_con:5>any_total.sd„5dy„sells = 0, THEN raw_score = 0 
And start over with the next aQalyst/coiiq)any buy combination 



15 IF analyst_con5)any_total.sd_20dy_sells = 0, THEN raw_scoxe sell = 0 
And start over with the next analyst/conQ>any buy combination 



IF analyst_conq)any_total.sd_60dy_sells = 0, THEN Taw_scQrB_sell = 0 
And start over with the next analyst/coiig)any buy combination 



20 



Sday _ abs _ tstat „ seU = 



analyst ^company hiatal jo^g^Sdy _retum_seU 



analyst ^company ^total^d _5dy sett 
^ -^analyst ^company _ total Jium _5dy_event „seU 



TXkiay _abs _tstat _sett = 



analyst ^company _totaljivg „ 20rfy ^return _ sett 



^ analyst ^company _totalM Jlfidy _seU ^ 
^analyst ^company _totalMum ^20dy _evertt_sett 



25 €Oday _abs _tstat _seU = 



analyst ^company _totaljavg _&kfy _retum_sett 



analyst ^company _total^d _ 60dy _ sell 
^analyst ^company _totalMim „60dy _event_seU 



I 
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Step 3 

The degrees of freedom are smq)ly calculated by subtracting 1 from the number of obs^ations for 
each return value: 

5 5day_^_seU =anafyst_con^}any'totaLnum_5dy_event_event_s€U-'l 
20day_^_j€U = analyst j::ompany_totaLjuim_20dy_€ventjsell'l 
60dayjff_se11 = analyst_company_totaLnunj50dy_eventjseU-l 
Step 4 

For each return period, lookup the probability using the absolute t stat and DF for each respective 
10 calculation as inputs to a lookup table: 

IF 5/20/60day_df_seU > 100, THEN set 5/20/60day_dt_seIl = 100 

IF 5/20/60 abs_tstat_sell > 20, THEN set 5/20/6Oday_abs_tstatj5ell = 20 

15 

IF 5/2Q/60day„absjtstat sell < .01 . THEN set 5/20/60day jrob.sell = 0 



5day_prob_sell = lookup value indicated by ushig 5day„absjtstat_sell and 5day_djLsell 
20 20day^ob_sell = lookup value indicated by using 20day_abs„t5tat_^ll and 20day_dt.sell 
60day_prob_sell = lookup value indicated by using 60day„abs_tstat_sell and 60day_dt3ell 
StepS 

25 The conditional raw score may now be calculated. The conditional raw score will be based on the 
average of the conditional raw scores for the 5 day period, 20 day period and for the 60 day period, 
which will then be multiplied by 100, The condition to determine whether the probability is added or 
subtracted is based on whether the average return is positive or negative, the formula is as follows 

( cond _ raw _ score _ sell ): 

30 

[l~(S^■or-5day_prob_seU)]■^ [i-(S-k-or- TOdcy^prob^sell)] + p-(5 + or-60day_prob_seU)]\ 



Logic: (Note: We are now using less than zero, which is opposite of the Buy logic) 



I 
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5 day portion of calculation 

IF analystjcon^any total.avg_5dy_xetum^sell < 0 

THEN subtract 5day_prob firom .5 in nunierator 

5 

- This next case means that we have a positive average return for the events and we may add the 
probability 

ELSE add 5day_pn)b to .5 in nun^rator 

10 

20day portion of calculation 

W analyst con5>any„total.avg_20dy jTetum_sell < 0 

TEEN subtract 20dayj;>rob ftom .5 in numerator 

IS - This next case means that we have a positive average return for the events and we need to add the 
probability 

ELSE add 20day^iDb to .5 in numerator 

20 60day portion of calculation 

IF analyst_coiEq[)any„total.avg_60dy jetum sell < 0 
THEN subtract 60day.4>rob fix>m .5 in numerator 

- This next case means that we have a positive average return for the events and we need to add tl^ 
23 probability 

ELSE add 60day_prob to .5 in numerator 

Finid step 

30 Take the average of the three calculated values above and multiply the result by 100 
Step 6 

Calculate the adjustment to the conditional raw score using the following fommla (the adjustment will 
always be negative): 

35 



> 
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adJ_raw_seU= (-20) * 



1 




f wttOT - 5dy _ events _ sell + /mm _ IXSdy _events _ seU -f num „ 60flfy _ events _ seU 



3 



- nuin^dy_eveiits sell, niinL.20dy„events_sell and nuDau60dy_events„sell are all taken ftom the 
anaIyst_conq)any_total table- 

Step7 

Calculate the raw sell score by adding the adjustment to the conditional raw score: 
raw_scorB_selI = (cond_jraw_scoTe_sell) + (adj_jaw_sell) 



- here we are adding a negative number (adj_raw_sell), therefore the adjustment should generally be 
negative — 



(])5 day returns portion of calculation 

IF analyst conq)any_total.avg_5dy_xeturn_sell > 10 

THEN 5day_sell_adj2 = 10 

25 - This next case means that we have a 5 day letutn less or equal than 1(X)0% and should use the 

following formula. Note the formula is raised to the third power which is equivalent to the cube root 

ELSE 5day_selLadj2 = (100 * analyst_conq)anyJotal.avg„5dy_j:etum„seIl)^ 



Step 8 

15 new_j:aw_score_sell = iaw_score_sell + (adj2 jraw_sell) 



Calculate second adjustment to raw_score_sell, variable name: adj2jaw_$ell 



The adj2 raw is con^sed of the following 4 components: 



20 



30 (2) 20 day returns portion of calculation 

TP analyst_con5)any_total.avg_20dy_yetum_sell > 10 
THEN 20day„selLadj2 = 10 
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- This next case means that we have a 20 day return less than or equal 1000% and should use die 
following formula. Note the fonnula is raised to die third power which is equivalent to the cube root - ■ 

ELSE 20day_sell_adj2 = (ICQ * analyst_company_totaLavg_20dy_xetuin_sell)"^ 

5 

(3) 60 day returns portion of calculation 

IF analyst_conq)any_total.avg_60dy_retuni_sell > 10 

THEN 60day_selLadj2 = 10 

10 - This next case means that we have a 60 day return less than or equal 1000% and should use the 

following formula. Note the formula is raised to the third power which is equivalent to the cube root - 

ELSE 60day_selLadj2 = (100 * analystjconq>any_total.avg„60dy_retum_sell)^ 

15 (a) SmaU Returns penalty 

IF analyst_conq)any_total.avg_60dyjretum_seD < -0,08 
THEN small_ret„selLadj = 0 

- This next case means that we negate returns less than or equal -8%, so we will inq>ose a penalty on the 
20 raw _sell_score - 

ELSE smalLret_sell„adj = (100 * (-0-08 - analyst„coiDpany_total,avg_60dyjietunusell)) 

Final step 

25 Combine the 4 components using the following formula to arrive at the final adj2_jaw_sell: 

adj2jraw_sell = (5day_seli_adj2/3) + (2(klay_selLadj2/3) + (60day_adj2/3) + smalLtet_sell_adj 
Step 9 

30 Final step is to eliminate returns from the final scoring that have 60 day returns greater than 1000% 

IF analyst_coiDpany_total.avg_60dyJ:etum_$ell > 10 
THEN filter this raw score in the final scoring process 



35 



Step 10 

Analyst Scoring Logic - Ranked (Final) Score 
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The following rankmg system may be used to detemune the final scores for each of the analyst scores: 

Iiiq>ortant Note: Only analysts that cover conq)anies within ±e Analyst Universe should be given a 
final Analyst score in this example 

5 

Analyst Sell Score 

Once all of the raw sell scores have been calculated, we can then rank the raw sell scores by sorting the 
results in descending order and separate this list into 100 groups. The group with the hi^est set of 
scores will be given the ranking of 100 (signifying the best sell p^onnance), and the group with the 
10 lowest set of scares wiU be given the ranldng of 1 (signifying the worst seU perfonnance). The analysts 
in each group should then be assigned a score equal to the group that they are in. 

Step 1 Develop list of analysts who have received a raw_seIl_score at conq>anies within the Analyst 
Universe 

15 Step2 Count the number of analysts in the list created in Step 1 

Step 3 Sort raw„selLscore list descending for all analyst.id/conopany Jid where there is a score. 

[Note: ff a secondary sort is needed, use analyst coirq»any_total.avg_60dyjretum_sell descending]. 

Step 4 Use the look up table shown below to divide the ranked first into seven groups, and then 

within each group divide the ranked raw_sell score list into an equal number of observations for each 
20 score within the group (as defined in the table shown below). 

Step S Record the score for the associated anafystjd and company Jd combinations in the group 

LookUp Table A 

25 

This look up table provides the information needed to assign the Analyst Buy Score and Analyst Sell 
Score for each analyst 

Using the rankings determined in Step 3 of Analyst Buy Score/Analyst Sell Score procedures derive the 
30 Analyst Buy Score and Analyst Sell Score split the rankings into the 7 groups m the table below. 



(jTOUp 


Percentages of Total 


Analyst Buy Score 


Analyst Buy Score 




Observations 


Clalculation 
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1 


Top S.0% (rounded 
up to the nearest 
whole number) 


Divide the top 5% of 
loiai oDservanons mio 
10 groups with an 
equal number of 
observations in each 
group 


91 to 100 


2 


Next 12.5% G-e. lead 
sorted records until 
leacn 17.5% of the 
total number o 
individuals from Stqp 
1 of the sconng 
procedures) 


Divide the 12.5% of 
total observations into 
15 groups with an 
equal number of 
observations in each 
group 


76 to 90 


3 


Next 18.0% (i.e. read 
sorted records until 
reach 35.5% of the 
total number of 
individuals from Step 
1 of the scoring 
procedures) 


Divide the 18.0% of 
total observations into 
15 groups with an 
equal number of 
observations in each 
group 


61 to 75 


4 


Next 29,0% (i.e. read 
sorted records until 
reacn D4.37b oi 
total number of 
individuals from Step 
1 of the sconng 
procedures) 


Divide the 29.0% of 
total obsmrations into 
20 groups with an 
equal numiber of 
observations in each 
group 


41 to 60 


5 


Next 18.0% (Le. read 
sorted records until 

total number of 
individuals from Step 
1 of the scoring 
procedures) 


Divide die 18.0% of 
total observations into 

equal number of 
observations in each 
group 


26 to 40 
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6 


Next 12.5% (i.e. read 


Divide the 12.5% of 


11 to 25 




sorted records until 


total observations into 






leacn 95.0% of the 


15 groups with an 






total number of 


equal number of 






individuals from Step 


observations in each 






1. of the scoring 


group 






piocedures) 






7 


Last S.0% (rounded 


Divide the last 5% of 


ItolO 




up to the nearest 


total observations into 






whole number) (Le. 


10 groiqis with an 






read sorted records 


equal number of 






until reach 100.0% of 


observations in each 






the total number of 


group 






individuals from Step 








1 of the scoring 








procedures) 







In accordance with the principles of the present invention, an analyst's performance (or other 
investment professional or investment advisor) is evaluated by utilizing information pertaining to at 
least one revision made by the analyst iuvolving at least one investment This evaluation includes 
5 determining a conditional performance score indicative of the analyst's performance relative to other 
analysts. The performance score is determined, at least in part, by considering an average historical 
performance of the investment following the revision. In addition, the performance score is also 
determined using a historical consistency of the analyst's performances with respect to revisions or 
reports involving the investnoent, and a number of revisions, recommendations, or opmions made by the 
10 analyst Then, the performance score may be adjusted according to one or more adjustments to 
generate a final performance score. 

These performance scores may be determined based on analyst recomnsendations, such as 
upward or downward revisions or a combination of both. In particular, a score based on upward 

15 revisions, or an upward revision performance score, corresponds to the predictive nature of an analyst 
with respect to predicting or influencing increases in earning. £a contrast, a score based on downward 
revisions, or a downward revision performance score, corresponds to the predictive nature of an analyst 
with respect to predicting or influencing decreases in earnings. Similarly, a combined score or, for 
example, an average of the two previous scores, corresponds to the overall predictive nature of the 

20 analyst 
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Hence, the present invention provides a method, system, and computer readable medium 
storing computer executable instructions for evaluating an analyst's performance by utilizing 
information pertaining to at least one revision made by the analyst involving at least one investroent In 
S one embodiment, the present invention includes determimng a conditional performance score indicative 
of the analyst's performance relative to other analysts. Tbis conditional p^ormance score is 
determined at least in part by considering an average historical performance of the at least one 
investn^nt following the at least one revision, a historical consistency of the analyst's performances 
with respect to revisions involving the at least one investment, and a number of revisions made by the 
10 analyst In addition, the present invention mcludes adjusting the conditional performance score of the 
analyst according to a return amount adjustment to generate a final performance score. 

In another embodiment, the present invention provides a method, system, and conq)uter 
readable medium storing conq>uter executable instructions for evaluating an analyst's performance. 

IS This embodiment includes utilizing information pertaining to at least one revision made by the analyst 
involving at least one investment, including an upward or downward change in opinion of the analyst 
with regard to at least one investment In addition, the present invention includes calculating a raw * 
conditional performance score indicative of the analyst's performance relative to other analysts, said 
raw conditional performance score det^mined at least in part by considering a measure of variability of 

20 the analyst's performance, an average historical performance of the at least one investment following 
the at least one revision, a standard deviation of the at least one revision, a number of tevisioiis 
the analyst, and a likelihood that the at least one revision will actually produce an e;q>ected result 
From there, the invention includes adjusting said raw conditional performance score according to a 
retum amoimt adjustment to produce a final performance score. 

25 

In another embodiment, the preset invention provides a method of evaluating an analyst's 
performance by utilizing information pertaining to at least one revision made by the analyst involving at 
least one investment In this embodiment, the invention includes calculating a raw conditional 
performance score indicative of the analyst's performance relative to other analysts. The raw 

30 conditional p^ormance score may be determined at least in part by considering a measure of 
variability of the analyst's performance, an average historical performance of the at least one 
investment following the at least one revision, a standard deviation of the at least one revision, a 
ninnber of revisions made by the analyst, and a likelihood that the at least one revision will actually 
produce an expected result Subsequently, the invention adjusts the raw conditional performance score 

35 according to a modifier accentuating the number of revisions made by the analyst In addition, the raw 
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conditional performance scoie may be adjusted according to a small return penalty penalizing the 
analyst for small returns to produce a final performance score. 

In still yet another embodiment, the present invention includes a method, system, and conq)uter 
5 readable medium storing conq)ut^ executable instructions for evaluating an analyst' s performance, and 
includes utilizing information pertaining to at least one upward or downward revision including an 
upward or downward change in opinion of the analyst with regard to at least one investment This 
embodin^nt also includes calculating a performance score indicative of the analyst's performance 
relative to other analysts, said perfonnance score determined at least in part by considering a measure 

10 of variability of the analyst' s performance, an average historical p^ormance of the at least one 

investment following the at least one inward or downward revision, a standard deviation of the at least 
one iq)ward or downward revision, a nimiber of upward or downward revisions made by the analyst, 
and a likelihood that the at least one upward or downward revision will actually produce an expected 
result In addition, this embodiment includes comparing the analyst's performance score against 

IS performance scores of other analysts to produce at least one of an upward, downward or combined 
revision ranking. 

In yet another embodin^nt, a method of evaluating an analyst's performance by utilizing 
information pertaining to at least one revision made by the analyst involving at least one investment is 

20 disclosed, hi this embodiment, the invention includes determining a first average return value (ave. 
retumi), second average retum value (ave. retum2), and thitd average return value (ave. retuma) for the 
at least one revision. Each of the first, second, and third average retum values corresponds respectively 
to an average rate of retum on the at least one revision involving the investment for a first period of 
time (timei), a second period of tin^ (time2)» and a third period of time (times). From there, a first t-stat 

25 value (t-stati) for ave. retumi, a second t-stat value (t-stat2) for ave. retumz, and a third t-stat value (t- 
stata) for ave. returns, are calculated, in absolute tenns. In particular, the first, second, and third t-stat 
values are calculated by utilizing ave. retumi, ave. retuni2, ave. letuma, a first standard deviation (SDi), 
a second standard deviation (SD2), and a third standard deviaticm (SDa), a total number of revisions 
(revisionsi) occiming more than or equal to timei before said evaluating, a total number of revisions 

30 (revisioriss) occurring more than or equal to tiinej before said evaluating, and a total number of 

revisions (revisionsa) occurring move than or equal to time^ before said evaluating. Subsequently, a 
first degree of freedom (DFJ for ave. retumi, a second degree of fireedom (DF2) for ave. retum2, and a 
third degree of fireedom (DFa) for ave. retuma are calculated. The invention then conten^lates 
determining a first probability (probi) for timei by utilizing t-stati and DFi, a second probability (prob2) 

35 for time2 by utilizing t-stata and DI^, and a third probability (proba) for times hy utilizing t-stata and 
DFa. A raw conditional performance score for the analyst is generated by utilizing probi, proba, proba. 
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A conditional pexfonnance score (cond. performance score) may be generated by adding a modifi^ 
(adjustment), which may be determined by utilizing revisionsi, revisionsa, and revisionss, to the taw 
conditional performance score. From there, the invention contemplates generating a small return 
penalty by subtracting a penalty from an av^ge of return factors corresponding to timei, tune2» and 

5 time3, wherein for iq)ward revisions the penalty is 0 if ave. returns is greater than 15%, else the penalty 
is equal to 15% minus ave. returns, wherein for downward revisions the penalty is 0 if ave. returns is 
less than -8%, else said penalty is equal to -8% zmnus ave. returns, wherein the first period of tin^ 
return factor is ten if ave. return] is greater than ten, else the first period of time return factor is equal to 
a cube root of a product of 100 and ave. retumi , wherein the second pedod of time return factor is ten if 

10 ave. retum2is greater than ten, else the second period of time return factor is equal to a cube root of a 
product of 100 and ave. retum2, and wherein the third period of time return factor is ten if ave. returns is 
greater than ten, else the third period of tin^ return factor is equal to a cube root of a product of 100 and 
ave. returns. Using the above factors, a final performance score (performance score) indicative of the 
analyst's performance may be generated by adding d^ small return penalty to the conditional 

15 performance score. 

There has thus been outlined, rather broadly, the more inq>ortant features of the invention in 
order that the detailed descrq>tion th^cof that follows may be bett^ understood, and in order that the 
present contribution to the art may be better appreciated There are, of course, additional features of the 
20 invention that will be described hereinafter and which will form the subject matter of the claims 
appended hereto. 

In this respect, before explaining at least one embodiment of the invention in detail, it is to be 
understood that the invention is not limited in its application to the details of construction and to the 
25 arrangements of the components set forth in the following description or illustrated in the drawings. 
The invention is capable of other embodim^ts and of being practiced and carried out in various ways. 
Also, it is to be understood that the phraseology and terminology employed herein are for the purpose 
of description and should not be regarded as limiting. 

30 As such, those skilled in the art will appreciate that the conception, upon which this disclosure 

is based, may readily be utilized as a basis for the designing of other structures, methods and systems 
for carrying out the several purposes of the present nivention. It is important, therefore, that the claims 
be regarded as including such equivalent constructions insofar as they do not depart from the spirit and 
scope of the present invention. 



35 
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Further, the purpose of the foregoing abstract is to enable the U.S. Patent and Trademark Office 
and the public generally, and especially die scientists, engineers and practitioners in the art who are not 
fanailiar with patent or legal terms or phraseology, to determme quickly ficom a cursory inspection the 
natureandess^ceof the technical disclosure of the application. The abstract is neither intended to 
5 define die invention of die application, which is measured by the claims, nor is it intended to be limiting 
as to the scope of the invention in any way. 

These togeth^ with othra: objects of the invention, along with the various features of novelty 
which characterize the invention, are pointed out with particularity in the claims annexed to and 
10 forming a part of diis disclosure. For a better understanding of the invention, its operating advantages 
and the specific objects attained by its uses, reference should be had to the accompanying drawings and 
desmptive matter in which there is illustrated preferred embodinoents of the invention. * 

Other objects of the present invention will be evident to those of ordinary skill, particularly 
15 upon consideration of the following detailed description of the preferred embodiments. 

NOTATIONS AND NOMENCXATURE 

The detailed descriptions which follow may be presented in terms of program procedures 
20 executed on conq>uting or processing systems such as, for exaic^le, a stand-alone gaming machine, a 
conq>uter or network of cotiq)uters. These procedural descriptions and representations are the means 
used by those skilled in the art to most effectively convey the substance of their work to oth^ skUled 
in the art 

25 A procedure is here, and generally, conceived to be a self-consistent sequence of steps leading 

to a desired result These steps are those requiring physical manipulations of physical quantities. 
Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable 
of being stored, transferred, combined, compared and otherwise manipulated. It proves convenient at 
times, principally for reasons of conumm usage, to refer to these signals as bits, values, elements, 

30 symbols, characters, terms, numbers, or the like. It should be noted, howev^, that all of these and 
similar terms are to be associated with die appropriate physical quantities and are noerely convenient 
labels applied to these quantities. 



35 



Further, the manipulations performed are often referred to in terms, such as adding or 
comparing, which are conmumly associated with msatal operations performed by a human operator. 
No such capability of a human operator is necessary, or desirable in most cases, in any of the operations 



wo 01/80124 



PCT/USOl/11691 



25 

described herein which form part of the present invention; the operations are machine operations. 
Useful machines for performing the operation of the present invention include general purpose digital 
computers or similar devices. 



5 BRIEF DESCJOPTION OF THE DRAWINGS 

FIG. 1 illustrates a prior art stock and cash portfolio development system; 
HG. 2 illustrates a prior ait securities valuation system; 
FIG. 3 illustrates a prior art investment fund management system; 
10 HG. 4 illustrates a prior ait data processing system for selecting securities and constructing 

investment portfolios based on a set of aiti&cial neural networks; 

FIGS. 5a-5b depict one example of a user interface utilizable for displaying an analyst 
evaluation according to the principles of the present invention; 

FIGS. 5c-5d depict one exanq)le of a user interface displaying exanq)les of revisions utilizable 
IS in conjunction with the principles of the present mvention; 

HG. 6 is a flow diagram illustrating a process for evaluating analysts according to the 
principles of 1ih& present invention; 

FIG. 7 is a flow diagram illustrating a higji level process for generating an iq)ward revision 
performance measure utilizable in the process of FIG. 6; 
20 FIG. 8 is a flow diagram illustrating a bi^ level process for generating a downward revision 

performance measure utilizable in the process of HG. 6; 

HG. 9 is a flow diagram illustrating a process for generating an i:q>wanl revision small return 
adjustment utilizable in the processes of HG. 7; 

HG. 10 is a flow diagram illustrating a process for generating a downward revision small 
25 return adjustment utilizable in the processes of HG. 8; 

HG. 11 is a flow diagram iUustrating a process for ranking analysts according to an upward 
revision performance measure utilizable in the process of HG. 7; 

HG. 12 is a flow diagram iUustrating a process for ranking analysts accordiiig to a down^^^ 
revision p^ormance measure utilizable in the process of HG. 8; 
30 HG. 13 illustrates one example of a central processing unit for int^lementiag a conq>utBr 

process in accordance with a computer implemented embodiment of the present invention; 

HG. 14 illustrates one exaniple of a block diagram of internal hardware of the c^tcal 
processing unit of HG. 13; 

HG. IS iUustrates another example of a block diagram of internal hardware of the central 
35 processing unit of HG. 13; 
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FIG. 16 illustrates one exan^le of a memory medium which may be used for storing a 
conq)uter inq>Ieniented process of the present invention; 

FIG. 17 illustrates an exan^le of a combined Intemet, POTS, and ADSL architecture which 
rnay be used with the present invention; and 
S HG. 18 shows a set of tabulated results of an evaluation performed according to the principles 

. of the present in vention. 

BEST MODE FOR CARRYING OUT THE INVENTION 

1 0 Refet^ce now will be made in detail to the presently preferred embodiments of the inventionu 

S uch embodimraits are provided by way of e?q>lanatiQn of the invention, which is not intended to be limited 
thereto. In &ct, those of ordiiiary sldU in the art rnay appreciate upon reading the pres 
viewing the present drawings that various modiGcadons and variations can be made. 



1 S For exanq>le, features illustrated or described as part of one embodiment can be used on other 

embodiments to yield a still fbth^embodirn^ Additionally, cesrtain features noay be interdianged with 
sirnilar devices cofeatures not inentioned yet wUch perform the sarne or siinilarfm It is therefore 
int^ded that such modifications and variations are included within the totality of the present inventioa 

20 In accordance with the principles of the present invention, an analyst* s performance is 

evaluated by utilizing mformation pertaining to at least one revision made by the analyst involving at 
least one investment This evaluation includes determining a conditional performance score indicative 
of the analyst's performance relative to other analysts. The performance score is determined at least in 
part by considering an average historical performance of the investment following the revision. In 

2S addition, the performance score is also determined using a historical consistency of the analyses 

performances with respect to revisions involving the investment, and a nimib^ of revisions made by the 
analyst Then, the performance score may be adjusted according to one or more adjustn^nts to 
generate a filrud performance score. 

30 These performance scores may be determined based on upward or downward revisions or a 

combination of both. In particular, a score based on upward revisions, of an upward revision 
performance score, corresponds to the predictive nature of an analyst with respect to predicting or 
influencing increases in earning. In contrast, a score based on downward revisions, or a downward 
revision performance score, corresponds to the predictive nature of an analyst with respect to predicting 

35 or influencing decreases in earnings. Similarly, a combined score, or for exasxspl& an average of the two 
previous scores, corresponds to the overall predictive nature of the analyst 
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Referring first to FIGs. Sa and 5b, one exanq)le of a user interface 500 utilizable for displaying, 
for exar[q)Ie, analyst performance scores is illustrated In HG. 5, the user interface displays a wide 
variety of information including perfonnance scores for any numb^ of companies 510. To calculate 
5 the conoqpany performance scores in this example, the scores for each of the analysts covering a 
particular company are averaged to produce an overall conq>any score. In addition to listing and 
determining an average of the performance scores of all the analysts covering a conopany, any 
combination of perfonnance scores may optionally be determined and listed. For instance, an average 
of only the upward or downward revision performance scores for the analysts covering a particular 
10 con^any may be deteamined and listed. Alternatively, a user may just as easily elect to view a list of 
only the upward or downward revisions for a single conqiany. Similarly, an index of individual analyst 
performance scores, independent of the conq>anies, based either on upward or downward revisions or 
both may also be determined and listed. 



15 Advantageously, these performance scores are a measure of the predictive nature of each 

analyst's revisions. In one exan^)le, a revision is a change in the opinion of an analyst on a 
performance of a company or other entity, for example, overall conq>any revenues, profits, market 
share, and/or how much a conq)any is lilcely to eamper share in a future quarts, fiiscal year, or other 
time period For instance, as shown m HQs. 5c-5d, other examples of revisions utilizable with 

20 embodiments of the present invention include detailed analyst recommendations on whether to sell, 
hold or buy a security 530, earnings surprises 532, estimates submitted 534, price/earnings 536, 
momentum!, price/earning ratio, P/B and growth rates, and/or PEG ratio, and/or other similar 
information/estimates. Some causes for an upward revision include: the release of a good quarterly or 
annual earnings report, a positive analysts* meeting or conference call with company executives, or 

25 improvements at a similar company in the same industry. Likewise, causes for a downward revision 
include: the release of a grim quarterly or annual earnings report, a negative analysts' meeting or 
conference caU with coiiq>any executives, or worsening results at a similar coicpany in the same 
industry. 

30 In the present invention, the higher the score of the analyst (with one4iundred, for example, 

being the highest), the more predictive on a historical basis. Furthermore^ the performance score 
increases with the number of beneficial revisions of the analyst For instance, the performance score 
increases when a rate of retum of an investment increases and the revision is an inward revision, or 
when a rate of retum of the investment decreases and the revision is a downward revision. Likewise, 

35 the performance score decreases when a rate of return of the investment decreases and the revision is an 
upward revision, or when a rate of retum of the investment increases and the revision is a downward 
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revision. Thus, a high upward revision performance score corresponds to historically high positive 
returns (e.g., the analyst issued an upward revision, and the stock went up in value). Smulaily, a high 
downward revision p^onnance score corresponds to high negative returns (e.g., the analyst issued a 
downward revision, and the stock went down in value). In addition, it should be noted that although in 
5 this particular embodiment corporate securities are mentioned as being one examplo of the analyst's 
revisions, the instant invention is also applicable to and should be construed as encojonpassing any other 
form of similar investment Some exanq)les include bonds, currencies, commodities, paper, precious 
metals, minerals, natural resources, mutual funds, and the like or any other analogous investments 
and/or investment entities. 

10 

As will be discussed in greater detail below, several factors are incorporated into these 
performance scores. For instance, an analyst's average return history (e.g., a return amount typically in 
a percentage calculated over a pred^rmined period of time after the analyst' s revision) for both 
upward and downward forecast revisions may initially be considered. Mdeed in alternative 

IS embodiments, this factor is accorded the greatest ainount of weight Next, the analyst's historical 
consistency at issuing upward and downward revisions in a company* s stock, as naeasuied by, for 
exaiiq)Ie, standard deviation and the like are also considered. In arelaled manner, a measure of 
variability of the analyst's performance noay also be considered. Similarly, a likelihood that the 
revision will actually produce an expected result, as embodied by statistical characteristics such as 

20 probability and the like are also factored into the calculation. EboaUy, the number of revisions that 
make up an analyst' s track record is factored into the p^ormance score for the sinq>le reason that the 
more times an analyst has demonstrated good judgment the better. Other factors are optionally used as 
well. 

25 As to the analyst's average return history, any number of retum periods may be considered. 

For example, in one embodiment, two periods are utilized. In other embodiments, three or more 
periods may be used Furthermore, any length of time is possible. Thus, in some cases, two periods 
(e.g., a relatively short period of time and a relatively long period of time) suffices. In other cases, one 
or more intermediate periods of time may also be included into the calculation. As examples, three 

30 month and six month periods may be used. As another example, five, twenty, and sixty day periods 
may be used. Similady, one week, one month, and two month periods are also possible. 

In addition to the above, other factors may optionally be considered as well. For exanq)le, the 
above factors may be utilized to generate a conditional or raw performance score, which in turn may be 
35 roodified or adjusted to produce a final perforinance score. For instance, a modifi^ accentuating the 
number of revisions made by the analyst may be factored into the conditional performance score. In 
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other cases, a return amount adjustinetit may be made to reward or penalize an analyst for small or large 
return amounts. For examgple, the return amount adjustment may include a small return penalty 
penalizmg or reducing the analyst's performance score for returns less than a predetermined amount 
More specifically, a penalty may be inqMDsed for returns of less than a predetermined anoount as 
S calculated over a predetermined period of time. Hence, with upward revisions, a penalty might be 
loosed for returns of less tfian approximately 15% as calculated over approximately a two month 
period of time. In contrast, with downward revisions, a penalty might be inqKtsed for returns greater 
than -8% as calculated over a two month period of time. Likewise, high returns may also result in 
increases to the analyst's performance score. Further, adjustments need not be limited to return 
10 amoimts. As an example, adjustnoents may be made to a performance score for an extremely large 

number of accurate trades. Mdeed, the present invention contenoplates modifications or adjustments for 
nearly any factor utilizable for predicting accuracy or reliability. 

Returning to the interface displayed in HG. 5, in addition to listing the average scores for all of 
15 the analysts associated with a particular conqiany, the interface may also be used to Ust each of the 
highest performing analysts for categories pertaining to downward and upward performance scores. 
Furthermore, int^ace 500 may also be linked to or used to display information concerning each 
analyst and/or the corresponding security. Likewise, the interface sponsor may optionally include 
commentary concerning, for exaiiq)le, any securities or analysts, advertisements utilizable as a source 
20 of rev^ue, instructions or help information for beginning users, and information concerning or tracking 
the activities of exceptionally hig^ performing analysts, or other similar features. 

While the interface depicted in FIG. 5 is used to view the average of the performance scores 
associated with a particular list of coII^)anies, other listings are also possible. For exanq)le, a user may 

25 select a particular analyst for review. In this case, each of the upward, downward, and combined 

performance scores for that analyst may be viewed. Furthermore, if the selected analyst is responsible 
for monitoring more than one con^any, multiple values for upward, downward, and combined 
performance scores (e.g., one score for each company) may be listed. Similarly, a user may select any 
combination of analysts or sets/groupings of data including, for example, all analysts dealing with or 

30 investing in a particular industry or market, or other analogous listings of information. 

A broad overview of the process of one embodiment of the present invention for calculating 
performance scores is now illustrated with reference to FIG. 6. First, a list of analysts is retrieved, from 
one or any number of databases 610. As will be discussed in greater detail below with refer^ce to 
35 FIG. 17, the database may include alist of any or all of a variety of combinations of analysts. For 
example, all of the analysts tracking co^^>aIlies in a single industry may be included Similarly, the 
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database may include all inside filing inside documents with the SEC la other embodiments, other 
similar or analogous techniques may be utilized to generate a list of analysts. For example, any one of a 
variety of databases tracking industry leaders may just as easily be used. 

S Aft^rettieviagthelistof analysts, a smaUar list of aiialysts to be evaluated is optionaU 

generated according to predetermined criteria, hi this regard, a check is performed identifying analyst 
that meet predetermoned criteria 615. In this example, any number of criteria may be used to generate 
this Ust For example, each analyst may be required to be an actual living person, thereby excluding 
brokerage firms. Thus, in tins scenario, any entities that are not people, such as conq>anies, 

10 partnerships, or trusts, are removed from the evaluation list As another example, the market 

capitalization of the conq>any being monitored may be required to be greats than a predetermined 
amount, such as, for instance, $50 million. Third, each analyst noay be required to have issued a 
minimum number of revisions that have been in existence for a certain period of time. Forinstance, 
some embodiments may require analysts to have issued at least two revisions, with each revision being 

15 at least sixty days old. Other embodiments may require more or fewer revisions, which in tum may be 
more recent or older than sixty days. These requirements are disclosed for exemyplaiy purposes only 
and it is to be understood that other types of analyst requireioents are possible within the scope of the 
invention. For instance, non-people analysts such as partnerships, corporations, and other joint ventures 
or entities are also possible where groups of analysts participate in recommendations and/or decision 

20 making. Thus, a group of, for exanple, Morgan Stanley analysts may be conq)ared against Goldman- 
Sachs analysts, individually or overall. Similarly, entities not having market capitalization or trading 
limits are also possible. Furthermore, the concepts of the present invention are applicable to entities 
investing ia investments other than securities, such as bonds, mutual funds, or any other similar 
investments, trading securities, investments and the like. 

25 

If the analyst does not meet the predetermined criteria (615), a message is retumed, and the 
analyst is not evaluated 620. On the other hand, if the analyst meets the predetermined criteria, 
processing continues with the calculation of a performance score for the analyst 625. As will be 
discussed below, this performance score may reflect inward revisions, downward revisions, or a 
30 combination, and/cH- average distribution of tiie two. From there, processing continues with a 
determination of whether more analysts exist to be ranked 630. 

Jf more analysts are to be ranked, processing returns to 61 0. If the list of analysts to be ranked 
is conq)lete, each of the analysts noeeting the predetermined criteria are ranked 635. Subsequently, 
35 these rankings may optionally be disseminated 640 via, for example, a us» interface similar to that 
depicted in FIG. 5 in a local or global setting, e.g., intranets, the Ihtemet, and the like. Alternatively, 
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the rankings may be disseminated in any other similar or analogous medium, such as in a magazine or 
newspaper, a trade journal, television, and radio or the like. 

Although in this embodiment a list of analysts to be evaluated is det^mined according to 
5 predetermined criteria, it is to be understood that other alternatives are also possible. For instance, the 
present inv^tion is to be construed as including scenarios where a user enters or selects a 
predet^mined listing of analysts for evaluatioiL In such a case, only the particular entities entered by 
the user would be evaluated. It is also possible that a mixed grouping of investment entities and types 
may be evaluated. For instance, it is possible within the scope of the present invention to evaluate 
10 corpcHiate insiders, noiq)er5on joint ventures, brokerage firms, and/or corporations, and any other types 
of investment entities or combinations thereof. 

The calculation of an iq)ward revision pesf onnance score is now described with reference to 
FIG. 7. Iq this example, one or more rates of return on an investment corresponding to an analyst's 

IS upward revision, taken a predetermined period of time after issuance of the upward revision, are 

utilized in the generation of die performance score. Thus, one or more return values for one or more 
returnintervalsareiriitiaUy calculated or gathered for each analyst 70S by any suitable iiie^ In this 
particular embodiment, three return values, one for a short period of time, one for an iatermediate 
period of time, and one for a long period of time, are taken. As to the actual amount of time associated 

20 with each period, any lengths may be used. For exanq>le, the short period of time may be five days or a 
week, the intermediate p^od may be twenty days or a month, and the long period may be sixty days or 
two months. Furthermore, three return values are utilized m this embodiment for exen:q>lary purposes 
only. In actual practice any number of return values, at any number of time intervals, are allowed so 
long as they are suitable proxies for, e.g., short, long, and optionally intermediate periods of time. As 

2S an example, two return values, one at 3 months (e.g., 13 we^eks) and a second at 6 months (e.g., 26 
weeks), may just as easily be utilized. 

la accordance with the principles of the preset invention and as discussed briefly above, these 
scores or measures reflect an analyst's performance and are generated by considering a number of 

30 performance factors. One ernbodiinent of the present mvention uses a ineasure of the aiialyst's 

historical performance as determined by rates of r^um over certain periods of tinne after a revision. 
Another exanq>le may include considering the analyst's success at selecting entry and exit points in the 
investment Additionally, as wiD be discussed below, the analyst's performance score may be modified 
or weighted based on a number of revisions made by the analyst, the magnitude of a return, or other 

3S similar factors. Of course, the above £u;tors are listed for exerrq>lary purposes only aiid it is to b^ 
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understood that other sinular and analogous factors may also be considered so long as they provide an 
accurate and/or estimated measurement of the analyst's success or lack thereof. 



10 



Aft^ calculating the letum values, a statistical measure of confidence in the analyst's 
performance may be calculated for each return value 710. As one exan^le, a t-statisdc or t-stat, taken 
in absolute terms, is utilized as this measure of confidence. The t-stat is a measure on a random saiiq>le 
(or pair of samples) in which a mean (or pair of means) appears in the numerator, and an estimate of the 
numerator's standard deviation appears in the denominator. The latt^ estimate is based on the 
calculated san^Ie variance estimates of the sauries. Alternatively, other standard variance measures or 
other suitable indices of variability may optionally be used in place of standard deviation, and/or t-stat 
ff these calculations yield a value of (t) that is sufBciently different from zero, the test is considered to 
be statistically significant 



In this embodiment, the t-stats for each return period may be determined by: 

upward revision return 



upward revision t stat = 



upward _ revision _ SD 



total _ number ^of _ upward „ revisions ^ 



IS In this example since three intervals are being utilized, three t-stat values are calculated, one for each 
interval. 



To prevent division by zero, if the standard deviations for any of the time intervals are zero, 
then tl^ conditional upward revision performance score for that interval is set to zero. In addition, 

20 although the t-stat is used in this exarnple, c^her measures of confidence may just as easily be 

incorporated in the present invention. As another example, the z-statistic or other similar measurements 
of variability, dispersion, or consistency may be used Furthermore, regardless of what method is used 
to produce the measure of confidence, the measure of confidence may also be manipulated or weighted 
to consider other factors, so long as it accurately reflects or estimates, for instance, the analyst's return 

25 history and historical consistency at issuing forecast revisions in the investment 

Afi^ calculating the measures of confidence (e.g., the t-stats for each time interval or return 
period), one or more degrees of freedom are determined by subtracting, for exanqile, one from the 
number of revisions for each return value 715. Hence, with three return values, three degrees of 
30 freedom are generated. The degrees of freedom are used to describe the number of values in a final 
calculation of a statistic that are free to vary, and measure, for exanple, repetition, repeatability, and 
certainty. Hence, each degree of freedom is determined by: 
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upwanl revisicm degree of freedom = total number of upwaid rev^ 

Next, a probability indicating, for example, the likelihood that an analyst's and/or other 
investing entity's actions will actually produce flie e;q>ected result, is determined for each letum 
interval 720. Thus, with three return intervals, three probabiUties are generated. In this exanD^le, the 
S degrees of freedom, along with the absolute t-stats, are used in determining a probability for each return 
period 720. Specifically, subject to the following optional conditions, the probabilities are looked-up in 
a common statistics Iookiq> table using each retum interval's degree of fieedom and t-stat If any of the 
degrees of freedom are greater than 100, then that degree of freedom is set to 100 before looking rxp the 
probability. If any of the absolute t-stats are greater than 20, then that absolute t-stat is set to 20 before 
10 looking up the probability. Finally, if any of the absolute t-stats are less than 0.01, then the 

corresponding probability is sinq)ly set to 0. In addition, the probabilities may be calculated utilizmg 
other methods. For instance, the t-stat and the degree of freedom may undergo further manipulation 
before looking up the probability. Alternatively, oth^ analogous methods may be utilized in place of 
the look-up table to determine the probabilities. 



15 



20 



Subsequent to detranining the probabilities for each retum period, a conditional upward 
revision p^ormance score, or raw conditional upward revision performance score, is generated 725. 
Although other methods are possible, the conditional performance score in this exaiqple is determined 
by: 

co„d_up_per_scor^:=l^^-^-^''°'~'^-P'-^^^^'^-'^^^^ 1*100 



Iq this formula, up_probl, up_jm>b2, up_prob3 correspond respectively to the probability for a first, 
second, and third retum iutervaL Referring again to the above formula, whether the probabilities are 
added or subtracted is determined by the following conditions. If any of the three probabilities are 
25 greats than zero, then that probability is subtracted from 0.5. Otherwise, 0.5 is added to the 
probability. 

The conditional upward revision performance score represents an initial analyst performance 
measure with respect to upward revisions and may undergo one or more of any number of 
30 manipulations to result in various other refined performance measures and ultimately a final upward 
revision performance score. As an exanq>le, the conditional performance score may be weighted to 
place additional enq)hasis on the maturity of the corporation. Alternatively, investments in, for 
example, conservative sectors may also receive a modification. To more clearly illustrate, exemplary 
noodifiers accounting for the size of a retum and a number of revisions issued are discussed in greater 
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detail below. These modifications axe introduced for exeiiq)laiy reasons only and it is to be understood 
that other manipulations are also possible within the scope of the present invention. 

Initially, an optional iq)wai4 revision adjustment may be graerated to reflect and enq)hasize the 
S number of revisions issued by the analyst Specifically, a modification may be made to the conditional 
upward revision perf onnance score accentuating the number of toward revisions issued by the analyst 
73a 



In this example, the adjustment is detemuned by: 



10 



15 



20 



25 



up, rev. adj.= (-20)* 



I 



num^up_r€v\'¥num_up_rev2^-num_up_rev3 

3 



la the above formula, nunuup.revl, nuin^iq)jnev2, and nunuup_rev3 correspond respectively to the 
number of upward revisions for a first mterval, the number of upward revisions for a second mterval, 
and the number of iq>ward revisions for a third interval. As will be noted fit>m the above formula, three 
separate upward revision numbers or values for three time intervals are considered in this embodiment. 

As another exan^le, an upward revision return amount adjustment may be generated to 
enqihasize a large or small return amount after a revision forecast made by the analyst This adjustment 
may be utilized to penalize an analyst for a smaU return, or reward an analyst for a large return. 
Referring to HG. 9, one exanq>le utilizable for determining a return amount adjustment for an upward 
revision is illustrated. In this enibodiment, the return amount adjustment includes a small return penalty 
for reducing the conditional performance score for returns on the investment that are less than a 
predetermined amount Although any predetermined amount may be utilized, with upward revisions in 
this example, it is set to approximately 15%. The small return penalty is generated using an average of 
a number of return factors and a penalty amount More particularly, the small return penalty is 
determined in one embodiment by taking a difference between an average of a short period of time 
retum factor, an intermediate period of time return factor, and a long period of time return factor, and a 
penalty. Thus, each of a short period of time retum fector, an intermediate period of time retum factor, 
and a long period of time retum factor are initially calculated 90S, 910, and 915. 



30 



li this embodimi^t, subject to certain conditions discussed below, each of the period of time 
retum factors (e.g., short, intermediate and long retum fectors) is equal to a cube root of aretum 
percentage over a ccraesponding p^od of tin^ uidess the return is greater tiian approximately 10 or 
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1000%. If the leturn is greater than approxiinately 10 or 1000%, the factor is siitiply set to 10 or 
1000%. Thustorestatetheabove, if the average retuni for the pedod of time is great^^ 10, then 
the return factor is singly set to 10. However, if die average return for a period of time is not greater 
than 10, the return factor is equal to: 

5 

return factor = (100 * average iq>ward revision return)^ 

After calculating each of the return values, the optional penalty is generated 920. hi this 
embodiment, the penalty is a difference between a predetennined amount and a return for a 

10 predetermined period of time. The predeteriiuned period of time is optionally equal to a dine 

corresponding to the long period of time return factor. If the average return value corresponding to the 
investment for the predetmnined long period of time is greater than a predetermined amount, the 
penalty is simply set to 0. As an exaiiq>le, the period of time and the predetermined amount may be 
approximately sixty days and ^^proximately 0.15 or 15%, respectively. Thus in this exan^le, a penalty 

15 is calculated only if the return over a sixty day period of time is less than 15%. However, if the average 
return value corresponding to the investment for the long period of time is not greater than 0.15 or 15%, 
the penalty is equal to a product of 100 and a difference between 0. 15 (or 15%) and the average retom 
value corresponding to the investment for a sixty day period of time. In other words, if the average 
return value corresponding to the investment for the long period of time (e.g., sixty days) is not greater 

20 than 0.15 or 15%: 

penalty = (100 * (0. 15 - average upward revision return for the long period of time)) 

This penalty is then subtracted from the average of the return factors 925 (discussed above) and 
25 used to produce an c^tional adjustn^nt: 

adjustment = (short retum factor + intermediate return factor + long return factor)/3 - penalty 

Thus, in this exaixq)le, a small retum penalty is inq)osed for small returns (e.g., approximately 
30 15%) over a long period of time (e.g., approximately sixty days) after a revision. Once the retum factors 
and penalty have been determined and used to produce an adjustment, the adjustment(s) is added to the 
conditional perfomiance score to produce a final iq>ward revision performance score 735. 



35 



hi the above example, adjustments reflecting the number of revisions issued by the analyst and 
reflecting retum amoimts enq}hasizing a small retum amount are Qlustfated However, as discussed 
above, any other modifications are also possible. For instance, modifications may be made placing a 
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much greater emphasis on short term mvestments to generate an adjustment aimed at producing scores 
for use in formulating short term investn^nt strategies. Or, in contrast, greater weight may be placed 
on returns over longer periods of time to reflect, for exaiiq)le, a more conservative investment strategy. 



10 



The generation of performance scores based on downward revisions is similar to the generation 
of upward revision performance scores and is depicted in FIG. 8. However, iii contrast to upward 
revision p^ormance scores, downward revision performance scores are indicative of an analyst's 
influence or accuracy in predicting the performance of, for exan:q>le, a security after issuance of a 
downward revision. A conditional downward revision performance score may be manipulated in any 
nimiber of ways to produce refined or final downward revision performance scores. 



15 



20 



25 



As with the upward revision scores, processing commences with the calculation or 
determination of one or more retum values , or rates of return, for each analyst, tafcai a predetermined 
period of time after issuance of the downward revision 805 . Again, any number of retum values may 
betaken. In this particular ernbodiinent, three return values, one for a short period of tinie, one f 
intermediate period of time, and one for a long period of time, are taken. Furthemoore, any lengths may 
be associated with these periods of time (e.g., a short period of time of five days, an intermediate p^od 
of twenty days, and a long period sixty days). While, three retum values are utilized in this 
embodiment, any number of retum values, at any number of time intervals, are allowed. 

Subsequently, a statistical measure of confidence in the analyst's performance is calculated 
810. In this case, a t-statistic (t-stat), in absolute terms, is again utilized for exenq>lary reasons, and is 
likewise calculated for each retum value. Again, since three intervals are utilized in this ^canq>le, three 
t-stat values are calculated, one for each mterval. 

For downward revisions, the t-stats for each retum period are det^mined by: 



downward revision t stat = 



downward revision retum 



downward revision SD 



^ -yj total number ^of_ downward _ revisions j 



30 



like with the upward revision performance score, to prevent division by zero, if the standard deviations 
for any of the three time intervals are zero, then the downward revision p^ormance score for that 
interval is set to zero. 
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Again, as with the above example, it is to be understood that other measures of confidence may 
be substituted for the t-stat Also, any number of modifications are possible. As indicated above, as 
long as an accurate reflection of the analyst's return history and/or historical consistency at issuing 
downward revisions is considered, any measure of confidence, for example a z-stat or other similar 
5 measurement of variability, dispersion, or consistency may be used. 

After calculating the measures of confidence (e.g., the t-stats for each time interval or return 
period), one or more downward revision degrees of freedom are determined by subtracting, for 
exanq)Ie, one from the nxnnber of revisions for each retum value 815. Hence, with three return values, 
10 three degrees of freedom are generated. Each degree of freedom is determined by : 

downward revision degree of fieedom = total niunber of downward revisions - 1 

Subsequently, a probability indicating, for example, the likelihood that an analyst's and/or other 
15 investing entity's actions will actually {Hx>duce the expected result, is determined for each retum 

interval 820. In this exan[q>lQ, the degree of freedom values, along with the absolute t-stat values, are 
used in determining a probability for each retum paiod. Spedfically, subject to the following optional 
conditions, the probabilities are looked-up in a common statistics lookup table using each retum 
interval's degree of freedom and t-stat If any of the degrees of fieedom are greater than 100, then that 
20 degree of fieedom is set to 100 before looking up the probability. If any of the absolute t-stats are 

greats than 20, then that absolute t-stat is set to 20 before looking up the probability. Knally, if any of 
the t-stat are less than .01, then the corresponding probability is simply set to 0. Alternatively, the 
probabilities may be calculated based on other the methods. For exai^ple, the measures of confidence 
and degrees of freedom may be modified or manipulated before looking up the probability in tiie 
25 lookup table. Also, any other similar methods may be used in place of the look-up table to generate a 
probability. 

Subsequent to detmnining the probabilities for each retum period, a conditional downward 
revision performance score, or raw conditional downward performance score, is generated 825. 
30 Although other methods are possible, the conditional performance score in this exanq>le is determined 
by: 

. ^ f[l-{.5 + or-<fK'„proW)] + [l-(.5 + or-rf>v_pwW)]+[l-(.5+ar-J^^ 1 
cond^dtif _ per _ score -y ~ — — - — ^ ~ ' r It 



35 



In this formula, dw_probl, dw jrob2, dw jrob3 correspond respectively to the probability for a first, 
second, and third retum interval. Whether the probabilities are added or subtracted is detennined by the 
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15 



38 

following conditions. In contrast to iq>waid revisions, if any of the thiee probabilities are less than 
zero, then that probability is subtracted from 0.5. Otherwise, 0.5 is added to the probability. 



As with the above, the conditional downward revision performance score represents an initial 
analyst performance measure and may undergo one or more of any number of manipulations to result in 
various other refined performance measures and ultimately a final downward revision performance 
score. As examples, modifiers accounting for the size of return and the number of revisions issued are 
discussed in greater detail below. These modifications are introduced for exenqilaiy reasons only and it 
is to be undmtood that other manipulations are also possible within the scope of the present invention. 

For exanq)le, a downward revision adjustment may be generated to reflect and errq>hasize the 
numb^ of revisions issued by the analyst Specifically, a nKxiification may be made to the conditional 
downward revision performance score accentuating the number of downward revisions issued by the 
analyst 



Jn this exanqple, the adjustment is detmnined by: 
dw. rev. adj. = (-20)* 



Jn the above formula, num_dw_jevl, nunudwj:ev2, and nun^dwjrevS correspond respectively to the 
number of downward revisions for a first interval, the number of downward revisions for a second 
20 interval, and the number of downward revisions for a third interval. As will be noted from the above 
formula, three separate downward revision nunibers or values for three time intervals are considered in 
this embodiment 



As another example, a downward revision retum amount adjustment may be generated to 
25 enq>hasize a large or smaU retuni amount after a revision forecast rnade by the arialyst This adjustment 
may be utilized to penalize an analyst for a small return, or reward an analyst for a large return. 
Referring to FIG. 10, one exan[q>le utilizable for detennining a retum amount adjustment for a 
downward revision is illustrated. La this embodiment, the retum amount adjustment includes a small 
retum penalty for reducing the conditional p^ormance score for returns on the investment that are less 
30 than a predetermined amount Although any predetemunedarDOuntinay be utilized, with downward 
revisions, in this example, it is set to approximately negative 8%. The small retum penalty is generated 
usinganaverageof a number of retum factors and a penalty amount More particularly, the small 
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letum penalty is determmed by taking a difference between an average of a short pmod of time return 
factor, an intermediate period of time return factor, and a long period of time return factor, and a 
penalty. Hius, each of a short period of time return factor, an intermediate period of time return factor, 
and a long period of time return factor are initially calculated 1005, 1010, and 1015. 

5 

In this embodiment, subject to certain conditions discussed below, each of the period of time 
return factors (e.g., short, intermediate and long return factors) is equal to a cube root of a retum 
percentage ov^ a corresponding period of time, unless the return is greater than ^proximately 10 or 
1000%. If the retum is greater than approximately 10 or 1000%, the factor is siiiq)ly set to 10 or 
10 1000%. Thustorestatetheabove,if the average retum for the period of time is greater than 10, then 
the retum factor is sinq)ly set to 10. However, if the average retum for a period of time is not greats 
than 10, the retum Victor is equal to: 

retum factor = (100 * average downward revision return)^ 

15 

Aftercalculatingeachof the retum values, the penalty inay be generated 1020^ hi this 
embodiment, the penalty is a difference between a predetermined amount and a retum for a 
predetermined period of time. In this exanq)le, the predetermined period of tiine may be equal to a tim^ 
corresponding to the long period of time retum factor. If the average retum value corresponding to the 

20 investment for the predet^mined period of time is less than a predetermined amount, the penalty is 
simply set to 0. As an exaiiq)le, the period of time and the predetermined amount may be 
approximately sixty days and approximately negative 0.08 or -8%, respectively. Thus in this example, 
a penalty is calculated only if the retum over a sixty day period of time is greater than negative 8%. 
However, if the avemge retum value corresponding to the investment for the long period of time is not 

25 less than negative 0.08 or -8%, the penalty is equal to a product of 100 and a diJSerence between 
negative 0.08 (or -8%) and the average retum value corresponding to the investment for a sixty day 
period of time, hi other words, if the average retum value corresponding to the investment for the long 
period of time (e.g., sixty days) is not less than negative 0.08 or -8%: 

30 penalty = (100 * (-0.08 - average downward revision retum for the long period of time)) 

This penalty is then subtracted from the average of the retum factors 1025 (discussed above) 
and used to produce the adjustment: 

35 adj ustment = (short retum factor + mtermediate retum fector + long return f actor)/3 - penalty 
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Thus, in this exaicple, a small letum penalty is imposed for small letums (e.g.» approximately - 
8%) over a long period of time (e.g., approximately sixty days) after a revision. Once the return factors 
and penalty have been detennined and used to produce an adjustment, the adjustment(s) are added to 
the conditional performance score to produce a final downward revision performance score 835. 

5 

In accordance with the principles of the preset invention, one example of a process for ranking 
analysts according to iq>ward revision performance score is depicted with reference to FIG. 1 1. In 
particular, this process commences by sorting the analysts into descending (or ascending) upward 
revision performance score order HQS. Subsequenfly, as will be discussed in greater detail below, the 
10 analysts are separated into a number of groups 1110. Each group, then, is assigned a ranking 1115, 
with, for exan^ile, the group with the highest scores receiving a ranking of 100 (signifying the best 
performance) and the group with the lowest scoies receiving a ranking of 0 (signifying the worst 
performance). Thus, each analyst receives a rank equal to his or her group. 

15 Any method or procedure may be utilized to separate or divide the analysts into git>u^^ In one 

embodinoent, the analysts are sinq>ly divided to form a standard bell curve distribution. In oth^ 
enibodiments, other distributions are possible. As one exanople, the group of analysts is divided into 
seven groups based on upward revision performance score. 

20 The first of these seven groups includes the top 5% of the analysts as calculated according to 

upward revision performance score. The analysts felling into this first group are then divided into ten 
substantially equally sized subgroups. The highest oftbese subgroups is assigned arank of 100. The 
next subgroup receives a rank of 99. This process continues until the last subgroup of the top 5% group 
is assigned a rank of 91. 

25 

The second group includes the next 12.5% of the analysts as calculated according to upward 
revision performance score (e.g., 5% - 12.5%). The analysts falling into the second group are then 
divided into fifteen substantially equally sized subgroups. The highest of these subgroups is assigned a 
rankof90. Thenextsubgroiq> receives a rank of 89. This process continues until the last subgroup of 
30 the second group is assigned a rank of 76. 

The third group includes the next 18% of the analysts as calculated accordmg to upward 
revision performance score (e.g., 12.5% - 18.0%). The analysts falling into the third group are divided 
into fifteen substantially equally sized subgroups. The highest of diese subgroups is then assigned a . 
35 rank of 75. The next subgroup receives a rank of 74. This process continues until the last subgroup of 
the second groiq) is assigned a rank of 61. 
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The fourth group includes the next 29% of the analysts as calculated according to upward 
revision performance score (e.g., 18% - 64.5%). The analysts falling into the fourth group are divided 
into twenty substantially equally sized subgroups. The highest of these subgroups is th^ assigned a 
5 rank of 60. The next subgroup receives a rank of 59. This process continues until the last subgroup of 
the second groiq> is assigned a rank of 41. 

The fifth group includes the next 1 8% of the analysts as calculated according to iq>ward 
revision perfottnance score (e.g., 64.5% - 82.5%). Tlie analysts falling into the fifth group are then 
10 divided into fifteen substantially equally sized subgroups. The Invest of these subgroiq)S is assigned a 
rank of 40. Thenext subgroup receives a rank of 39. This process continues until the last subgroup of 
the second group is assigned a rank of 26. 

The sixth group includes the next 1Z5% of the analysts as calculated according to upward 
15 revision performance score (e.g., 82.5% - 95%). The analysts falling into the sixth group are divided 
into fifteen substantially equally sized subgroups. The highest of these subgroups is then assigned a 
rankof2S. The next subgroup receives a rank of 24. This process continues until the last subgroup of 
the second group is assigned a rank of 11. 

20 The seventh or last group includes the last 5% of the analysts as calculated according to upward 

revision performance score (e,g.» 95% - 100%). The analysts falling into the seventh group are then 
divided mto ten substantially equally sized subgroups. The highest of these subgroups is then assigned 
arankof 10. The next subgroup receives a rank of 9. This process continues until the last subgroup of 
the second group is assigned a rank of 1 . 

25 

As depicted in HG. 12, a similar procedure is utilized to rank the analysts with respect to 
downward revision performance scores. Thus this process is only briefly summarized here. MtiaUy, 
the process commences by sorting the analysts into descending (or ascending) downward revision 
performance score order 1205. Subsequently, the analysts are separated into a number of groups 1210. 
30 Then each group is assigned a ranking 1215, with, for example, the groiq> with the highest scores 
receiving a ranking of 100 (signifying the best performance) and the group with the lowest scores 
receiving a ranking of 0 (signifying the worst perfmnance). Like with the upward revision scores, each 
analyst receives a rank equal to his or her group. 

35 Similar to the upward revision procedure used to separate the analysts, any method may be 

utilized to divide these sorted analysts into groups. As one exaaq>le, the groiq) of analysts is divided 
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into seven groups based on downward revision perfonnance score. For instance, the first group may 
correspond to the top 5% and receive ranks ranging from 100-91. The second group may correspond to 
the next 12.5% of the analysts and receive ranks ranging from 90-76. The third group may correspond 
to the next 18% of the analysts and receive ranks ranging from 75-61. The fourth may correspond to 
5 the next 29% ofthe analysts and recdve ranks ranging from 60- 41. The fifth may correspond to the 
next 18% of the analysts and receive ranks ranging from 40-26. The sixth group may correspond to 
the next 12.5% ofthe analysts and receive ranks ranging from 25-11. The seventh or last group may 
correspond to the last 5% of the analysts and receive ranks ranging from 10-1 . 

10 In addition, as mentioned above, any other similar and analogous methods may be used to 

separate and/or divide the analysts into groups. For instance, each groiq> may be required to include an 
equal number of analysts. Similarly, different criteria may be used to determine the groiq)s. 

One example deleting the tabulated results of processing in accordance with the above 
15 techniques with respect to a group of andystscov^ing a single coiiq>any (IBM) is shov^ 18, 
In this exazxq>le, both upward and downward perfonnance scores are listed. Also, as discussed above, 
the scores may be averaged or otherwise combined to yield a combined p^ormance score. Oth^ 
alternatives are also possible. 

20 Viewed externally in FIG. 13, a conq)uter system designated by reference numeral 140 has a 

con^uter 142 having disk drives 144 and 146. Disk drive indications 144 and 146 are merely symbolic 
of a number of disk drives which might be acconmiodated by the computer system. Typically, these 
would include a floppy disk drive 144, a hard disk drive (not shown externally) and a CD ROM 
indicated by slot 146. The number and type of drives vary, typically with different computer 

25 configurations. Disk drives 144 and 146 are in fact optional, and for space considerations, are easily 
omitted from the conq>utCT system used in conjunction with the production process/s^paratus described 
herein. 

The conqiuter system also has an optional display upon which information, such as the screen 
30 illustrated in FIG. 5 may be displayed. In some situations, a keyboard ISO and a mouse 152 are 
provided as input devices through which a user's actions may be inputted, thus allowing input to 
interface with the central processing unit 142. Then again, for enhanced portability, the keyboard ISO 
is either a limited function keyboard or omitted in its entirety. In addition, mouse 152 optionally is a 
touch pad control device, or a track ball device, or evai omitted in its entirety as well, and similariy 
35 may be used to input a user's selections. In addition, the coisputer system also optionally includes at 
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least one infrared tramtoittex and/or infiaied received for either transnutting and/or receiviag infrared 
signals, as described below. 

FIG. 14 illustrates a block diagram of the internal hardware of the computer system 140 of HG. 
S 13. A bus 156 serves as the main information highway interconnectmg the other components of the 
computer system 140. CPU 158 is the central processing unit of the system, performing calculations 
and logic operations required to execute the processes of the instant invention as well as other 
programs. Read only memory (ROM) 160 and random access memory (RAM) 162 constitute the main 
memory of the computer. Disk controller 164 int^aces one or more disk drives to the system bus 156. 
10 These disk drives are, for exaizq>le, floppy disk drives such as 170, or CD ROM or DVD (digital video 
disks) drive such as 166» or int^nal or external hard drives 168. As indicated previously, these various 
disk drives and disk controllers are optional devices. 

A display interface 172 intei&ces display 148 and permits information frx)m the bus 156 to be 

15 displayed on the display 148. Again as mdicated, display 148 is also an optional accessory. For 
exanq)le, display 148 could be substituted or omitted. Communications with external devices, for 
example, the other conq>onents of the system described herein, occur utilizing communication port 174. 
For example, optical fibers and/or electrical cables and/or conductors and/or optical communication 
(e.g., infrared, and the Uke) and/or wireless communication (e.g., radio frequency (RF), and the like) 

20 can be used as the transport medium between the external devices and communication port 174. 
Peripheral interface 154 interfaces the keyboard 150 and the mouse 152, permitting input data to be 
transmitted to the bus 156. hx addition to the standard co^^>onCTts of the conoputer, the conq>uter also 
optionally includes an infrared transmitter 178 and/or infrared receiver 176. Infrared transmitters are 
optionally utilized when the computer system is used in exjunction with one or more of the processing 

25 coiiq>onents/stations that transniits/recdves data Wa infrared signal tramm^ lostead of utili!dng an 
infrared transmitter or infrared receiver, the computer system may also optionally use a low power 
radio tra^smitter 180 and/or a low power radio receiver 182 as shown in the alternate embodiment of 
FIG. 15. The low power radio transmitt^ transnoits the signal for reception by compoDents of the 
production process, and receives signals frx>m the conq>onents via the low power radio receiver. The 

30 low power radio transmitter and/or receiver are standard devices m industry. 

FIGS. 16 is an illustration of an exenq)lary memory medium 184 which can be used with disk 
drives illustrated m FIGS. 14-15. Typically, memory media such as floppy disks, or a CD ROM» or a 
digital video disk wiU contain, for exanq)le, a multi-byte locale for a single byte language and the 
35 program information for controlling the conq>uter to liable the computer to perform the functions 

described herein. Alternatively, ROM 160 and/or RAM 162 illustrated in FIGS. 14-15 can also be used 
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to stole the program iBformatioa that is used to instruct the central processing unit 158 to perform the 
operations associated with the instant processes. 



Althougjii conttputer system 140 is illustrated having a single processor, a single hard disk drive 
5 and a single local memory, the system 140 is optionally suitably equipped with any multitude or 
combination of processors or storage devices. Conq>uter system 140 is, in point of fact, able to be 
replaced by, or combined with, any suitable processing system operative in accordance with the 
principles of the present invention, including sophisticated calculators, and hand-held, laptop/notebook, 
mini, mainfTame and super conoputers, as well as processing system network combinations of the same. 

10 

Conventional processing system architecture is more fuUy discussed in Computer Organization 
and Architecturc. by Wlliam Stallings, MacMillan Publishing Co. (3rd ed. 1993); conventional 
processing system network design is more fully discussed in Data Network Design, by Darren L. 
Spofan, McGraw-Hill, Inc. (1993), and conventional data comnxunications are more fully discussed in 

15 Data Cnmm imicatinnR Principles , by RJD, (jitlin, J.R Hayes and S.B. Weinstain, Plenum Press (1992) 
and in The Lrwin Handbook of Telecommunications, by James Harry (jreen, Irwin Professional 
Publishing (2nd ed. 1992). Each of the foregoing publications is incorporated herein by reference. 
Alternatively, the hardware configuration is, for example, arranged according to the multiple instruction 
multiple data (MIMD) multiprocessor format for additional confuting ef&ciency. The details of this 

20 form of con^uter architecture are disclosed in greater detail in, for exanqjie, U.S. Patent No. 5,163,131; 
Boxer, A., Where Buses Cannot Go, IEEE Spectrum, February 1995, pp. 41-45; and Bairoso, L.A. et 
al., RPM: A Rapid Prototyping Engine for Multiprocessor Systems, IEEE Conq>uter February 1995, pp. 
26-34, all of which are incorporated herein by reference. 

25 In alternate preferred embodim^ts, the above-identified processor, and, in particular, CPU 

158, may be replaced by or combined with any other suitable processing circuits, including 
programmable logic devices, such as PALs (programmable array logic) and PLAs (programmable logic 
arrays). DSPs (digital signal processors), FPGAs (field programmable gate arrays), ASICs (application 
specific integrated circuits), VLSIs (very large scale integrated circuits) or the like. 

30 

HG. 17 is an illustration of the architecture of the combined Internet, POTS (plain, old, 
telephone service), and ADSL (asymmetric, digital, subscriber line) for use in accordance with the 
principles of the present inventioa Furthennore, it is to be understood that the use of the Internet, 
ADSL, and POTS are for exemplary reasons only and that any suitable conununications netwodc may 
35 be substituted without departing fix>m the principles of the present invention. This particular exan;>le is 
briefly discussed below. 
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Id fig. 17, to preserve POTS and to prevent a feult in the ADSL equipment 254, 256 from 
conqn?omising analog voice traffic 226, 296 the voice part of the spectrum (the lowest 4 kHiz) is 
separated from the rest by a passive filtea:, called a POTS splitt^ 258, 260. The rest of the available 
5 bandwidth from about 10 kHz to I MHz --carries data at rates up to 6 bits per second for every 
hertz of bandwidth from data equipment 262, 264, and 294. The ADSL equipment 256 then has access 
to a number of destinations including significantly the Internet 220 or other data comnmnications 
netwoiks, and other destinations 270, 272. 

10 To exploit the high^ frequencies, ADSL makes use of advanced modulation techniques, of 

which the best known is the discrete multitone (DMT) technology. As its name inq>Ues, ADSL 
transmits data asymmetrically - - at different rates upstream toward the central office'252 and 
downstream toward the subsoriber 250. 

15 Cable television providers are providing analogous Internet service to PC users over their TV 

cable systems by means of special cable modems. Such modems are capable of transmitting up to 30 
Mh/s over hybrid fiber/coax system, which use fiber to bring signals to a neighborhood and coax to 
distribute it to individual subscribers. 

20 Cable EQodems come in many forms. Most create a downstream data stream out of one of the 

6-MHz TV channels that occupy spectrum above 50 MHz (and more likely 550 MHz) and carve an 
upstream chaxmel out of the S-50-MHz band, which is currendy unused. Using 64-state quadrature 
ampUtude modulation (64 QAM), a downstream channel can realistically transmit about 30 Mb/s (the 
oft-quoted lower speed of 10 Mb/s refers to PC rates associated with Ethernet cormections). Upstream 

25 rates differ considerably from vendor to vender, but good hybrid fiber/coax systemis can deUver 

upstream speeds of a few megabits per second. Thus, like ADSL, cable modems transmit much more 
information downstream than upstreanL Tt^n Internet architecture 220 and ADSL architecture 254, 
256 may also be combined with, for exano^le, user networks 222, 224, and 228, 

30 In accordance with the principles of the present invention, in one example, a main coixq>uting 

server inf)lerDenting the process of the invention may be located on one con;>uting node or terminal 
(e.g., on user network 222, or system 240). Th^ various users may interface with the main server via, 
for instance, the ADSL equipment discussed above, and access the information and processes of the 
present invention from remotely located PCs. More specifically, a process 242 c£q>able of performing 

35 the analyst evaluating procedure of the instant invention may be advantageously implemented in system 
240. As dq)icted in FI& 17, process 242 may access a list of analysts stored, for instance in data 
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stroctuie 294. Furth^iDQre, although data stractoie 294 is shown as being stored in system 240, it may 
just as easily be located in a remote and distinct conq>uter system. For exanq)le, process 242 may be 
inqilemented in such a mann^ as to have access to one of any number of databases 281, 282, 283, 285, 
286, 287 or 288. 

Furthermore, the analyst evaluating process of the present invention may also be implemented 
manually. For instance, it is possible to evaluate analysts by hand without the assistance of conq)uting 
systems. 

The many features and advantages of the invention are apparent from the detailed specification, 
and thus, it is intended by the ^[^nded claims to cover all such features and advantages of the 
invention which fall within the true spirit and scope of the invention. Further, since numerous 
nK)difications and variations will readily occur to those skilled in the art, it is not desired to limit the 
invention to the exact construction and operation illustrated and described, and accordingly, all suitable 
modifications and equivalents may be resorted to, idling within the scope of the invention. 
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OAIMS 

What is claixned is: 

1. A method of evaluating an analyst's perfannance, said method conq)ri5ing the steps of: 
utilizmg information pertaining to at least one revision made by the analyst involving at least 

one investment, iDcluding an upward or downward change in opinion of the analyst with legard to the 
at least one investment; 

calculating a conditional performance score indicative of the analyst's performance relative to 
other analysts, said raw conditional performance score deteimined at least in pait by considmng a 
measure of variability of the analyst's performance, an average historical performance of the at least 
one investn^nt following the at least one revision, a standard deviation of the at least one revision, a 
number of revisions made by the analyst, and a likelihood that the at least one revision will actually 
produce an expected result; and 

adjusting said conditional p^ormance score according to a return aioount adjustment to 
produce a final performance score. 

2. The method of claim 1, wherein the average historical performance of the at least one 
investment is considered over three distinct periods of time. 

3. The method of claim 2, wherein said three distinct periods of time coxcprise a short period of 
time which is approximately five days, an intermediate period of time which is approximately twenty 
days, and a long period of time which is ^proximately sixty days. 

4. The method of claim 1, wherein the final performance score increases with the nmnberof 
revisions. 

5. The method of claim 1, wherein said revision comprises one of an upward revision or a 
downward revision. 

6. The method of claim 1 , wherein the final performance score increases when a rate of return of 
the at least one investment increases and die revision is an tq>ward revision, or when a rate of return of 
the at least one investn^nt decreases and the revision is a downward revision. 
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7. The method of claim 1, wheiein the final p^onnance score decreases when a rate of return of 
the at least one investment decreases and the revision is an upward revision, or when a rate of return of 
the at least one investment increases and the revision is a downward revision. 

S 8. The method of claim 1 , further comprising adjusting said canditional performance score 
according to a modifier accentuating the number of revisions made by the analyst 

9. The method of claim 1 , wherem said return amount adjustment comprises a small return 
penalty reducing said final performance score for returns on said at least one investment less than a 

10 predetermined amount. 

10. The method of claim 9, wherein said small retum penalty is comprised of a difference betwera 
an average of a short period of time retum factor, an intermediate period of time retum factor, and a 
long period of time retum factor, and a penalty; wherein said penalty is equal to ^proximately 15% for 

15 upward revisions and approximately -8% for downward revisions minus a retum value corresponding 
to the investment for said long p^od of time; and wherein each period of time retum factor is a cube 
root of a retum percentage over a corresponding period of tune. 

1 1 . The method of claim 9, wherein said small retum penalty is innposed for small returns over a 
20 long period of time of approximately sixty days after said at least one revision. 

12. The method of claim 9, wherein said small retum penalty is generated by subtracting a penalty 
ficom an average of a first, second and third period of time retum f acton wherein for upward revisions 
said penalty is 0 if an average retum value ccHresponding to the mvestment f ot a long term period of 

25 time is greater than 15%, else said penalty is equal to 15% minus said average retum value 

corresponding to the investment for a long term period of time; wherein for downward revisions said 
penalty is 0 if said average return value corresponding to the investment for a long term period of time 
is less than -8%, else said penalty is equal to -8% minus said average retum value corresponding to the 
mvestment for a long term period of time; wherein said first period of time retum factor is ten if an 

30 average retum over said first period of time is greater than ten, else said first period of time retum 

factor is equal to a cube root of a product of 100 and said average retum over said first period of time; 
wherein said second period of time retum factor is ten if an average retum over said second period of 
time is greats than ten, else said second p^od of time retum factor is equal to a cube root of a product 
of 100 and said average retum over said second period of time; and wherein said third period of time 

35 retum factor is ten if an average retum over said third p^od of time is greater than ten, else said third 



wo 01/80124 PCT/USOl/11691 

49 

period of time return factor is equal to a cube root of a product of 100 and said av«age return over said 
third period of tune. 

13. The znethod of claim 1, wherein said calculating a conditional performance score comprises: 
5 determining a first average return value (ave. retumi), second average return value (ave. 

retum2), and third average return value (ave. returns) for the at least one revision, said first, second, and 
third average return values corresponding respectively to an average rate of return on the at least one 
revision involving the investnaent for a first period of tune (timei), a second period of time (time2), and 
a third period of time (times); 

10 calculating, in absolute tenns, a first t-stat value (t-stati) for said first average return value, a 

second t-stat value (t-stat2) for said second average return value, and a third t-stat value (t-stata) for said 
third average return value, said first, second, and third t-stat values calculated by utilizing said first, 
second, and third average return values, a first standard deviation (SDi), a second standard deviation 
(SD2), and a third standard deviation (SD3), a total number of revisions (revisionsO occurring more than 

15 or equal to die first period of time before said evaluating, a total number of revisions (revisions^ 

occurring more than or equal to the second period of time before said evaluating, and a total number of 
revisions (revisionsa) occurring more than or equal to the third period of time before said evaluating; 

calculating a first degree of freedom (DFi) for said first average return value, a second degree 
of freedom (DF2) for said second average return value, and a third degree of fireedom (DF3) for said 

20 third average return value; 

determining a first probability (probO for said first period of time by utilizing said first t-stat 
value and said first degree of freedom, a second probability (prob2) for said second period of time by 
utili2dng said second t-stat value and said second degree of freedom, and a third probability (probs) for 
said third period of time by utilizing said third t-stat value and said third degree of fieedonu 

25 generating a raw conditional performance score fcH* the analyst by utilizing probi , prob^, and 

probj; 

generating an adjustment to said raw conditional performance score by utilizing revisionsi, 
revisions2, and revisionsa; and 

adding said adjusttoent to said raw conditional performance score to produce said conditional 
30 performance score. 



14. The method of claim 13, wherein if SDi = 0, then conditional performance score = 0 otherwise 
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Tstatx = 



ove. retuml 



SDl 



previsions! 



; wherein if SD2» = 0> then conditional perfonnance score = 0 otherwise 

ave. retuml 



Tstat2 = 



SDl 



-yjrevisionsl 



; wherein if SD3, = 0, then conditional perfi 
Tstat^ - 



formance score = 0 otherwise 
ave, returns 



r 



SD3 



-yJrevisionsS 



; wherein DFi = revisioosi - 1; DF2 = revisions2 - 1; and DF3 = revisionss - 1 

IS. The method of claim 13, wherein said probabilities are determined according to a 
predetermined look-up table using actual calculated values of: DFj, DF2, DF3, t-stati, t-stat2, and t-stats, 
unless: DFi> 100, in which case DFi is set to 100; DF2 > 100, in which case DF2 is set to 100; DF3 > 
100, in which case DFais set to 100; t-stati > 20, in which case t-stati is set to 20; t-stat2> 20, in which 
case t-statais set to 20; t-stata > 20, in which case t-statsis set to 20; t-stati < 0.01, in which case probi is 
set to 0; t-stats < 0.01, id which case prob2 is set to 0; or t-stata < 0.01, in which case proba is set to 0. 



15 16. Hie method of claim 13, wherein 



cond __ performance _ score 



_ f[l-(5+or-pn>M)] •♦-[l-(.5+or-pro^>2)]+[l-C5+or-profr3)] |^ 



100 



wherein for upward revisions probi is subtracted fiom 0.5 if ave. retumi > 0, else probi is added to 0.5 
wherein for upward revisioris proba is subtracted &om 0.5 if ave. retuma > 0, else proba is added to 0.5; 
wherein for upward revisions proba is subtracted from 0.5 if ave. returua > 0, else proba is added to 0.5; 
20 wherein for downward revisions probi is subtracted fironiO.5 if ave. retumj < 0, else probi is added to 
0.5; wherein for downward revisions prob2 is subtracted from 0.5 if ave. retuma < 0, else proba is added 
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to 0.5; and wherein for downward revisions probo is subtracted from 0.5 if ave. retuma < 0, else probj is 
added to 0.5. 

17. The method of claim 13, wherein 



18. A method of evaluating an analyst's perfonnance, said method comprising the steps of: 
utilizmg infonnation pertaining to at least one upward or downward revision including an 

upward or downward change in opinion of the analyst with regard to the at least one investment; 
calculating a performance score indicative of the analyst's performance relative to other 

10 analysts, said performance score determined at least in part by considering a measure of variability of 
the analyst's p^ormance, an average historical performance of the at least one investment following 
the at least one upward or downward revision, a standard deviation of the at least one upward or 
downward revision, a numiber of upward or downward revisions made by the analyst, and a likelihood 
that the at least one upward or downward revision wQl actually produce an expected result; and 

15 coiiq>aring the analyst's performance score against performance scores of other analysts to 

produce at least one of an inward, downward or comhined revision ranking. 

19. The method of claim 18, wherein said three distinct periods of time comprise a short period of 
time which is approximately five days, an intermediate period of time which is approximately twenty 

20 days, and a long period of time which is approximately sixty days. 

20. The method of claim 18, wherein said performance score increases with the number of 
revisions. 

25 21. The method of claim 18, further conq)rising adjusting said performance score according to a 
modifier accentuating the number of revisions made by the analyst 

22. The method of claim 1 8, wherein said performance score increases when a rate of return of the 
at least one iuvestment increases and the revision is an upward revision, or wl:^ a rate of return of the 
30 at least one investment decreases and the revision is a downward revision, and wherein said 

perfonnance score decreases when a rate of return of the at least one investment decreases and the 
revision is an upward revision, or when a rate of return of the at least one investment mcreases and the 
revision is a downward revision. 



1 



adjustments (-20)* 




5 
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23. The method of claim 18, further comprising adjusting said performance score according to a 
small return penalty. 

5 24. The rnethod of claim 23, wherein said smaU retum p^ialty is generated by subtractm 

fiom an average of a first, second and third period of time retum factor, wherein for upward revisions 
said p^ialty is 0 if an average retum value corresponding to the investment for a long term period of 
time is greater than 15%, else said penalty is equal to 15% minus said average retum value 
corresponding to the investment for a long term period of time; wherera for downward revisions said 

1 0 penalty is 0 if said average retum value corresponding to the investmmt for a long term period of time 
is less than -8%, else said penalty is equal to -8% minus said average retum value corresponding to the 
investment for a long term period of time; wherein said first period of time return ^tor is ten if an 
average retum over said first period of tinae is greater than ten, else said first period of time retum 
factor is equal to a cube root of a product of 100 and said average return over said first period of time; 

15 wherein said second period of time retum factor is ten if an average retum over said second period of 
time is greater than ten, else said second pmod of time retum factor is equal to a cube root of a product 
of 100 and said average retum over said second period of time; and wherein said third period of time 
retum factor is ten if an average retum over said third period of time is greater than ten, else sal d third 
period of time retum feictor i s equal to a cube root of a product of 1 00 and said average retum over said 

20 third period of tincte. 

25. The method of claim 18, wherein said calculating a performance score con^rises: 

determining a first average return value (ave. retumi), second average retum value (ave. 
returua)* and third average retum value (ave. returns) for the at least one revision, said first, second, and 

25 third average retum values corresponding respectively to an average rate of return on the at least one 
revision involving the investment for a first period of time (timei), a second period of time (times), and 
a third period of time (tuiie3); 

calculating, in absolute t^ms, a first t-stat vahie (t-stati) for said first average retum value, a 
second t-stat value (t-stats) for said second average retum value, and a third t-stat value (t-stats) for said 

30 third average retum value, said first, second, and third t-stat values calculated by utilizing said first, 
second, and third average retum values, a first standard deviation (SDi), a second standard deviation 
(SDz), and a third standard deviation (SD3), a UAai number of revisions (revisionsi) occurring more than 
or equal to the first period of time before said evaluating, a total number of revisions (revisionss) 
occurring more than or equal to the second period of tinoe before said evaluating, and a total number of 

35 revisions (revisionsa) occurring nKire than or equal to the third pmod of time before said evaluating; 
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calculating a first degree of fineedom (DFi) for said first average return value, a second degree 
of fi^om (DF2) for said second average return value, and a third degree of fteedom (DF3) for said 
third average return value; 

determining a first probability (probi) for said first period of time by utilizing said first t-stat 
value and said first degree of fieedom, a second probability (proh^ for said second period of time by 
utilizing said second t-stat value and said second degree of fi:eedom, and a third probability (proba) for 
said third period of thxm by utilizing said tiiird t-stat value and said third degree of freedom; and 

generating a conditional performance score (cond. performance score) for the analyst by 
utilizing probi, prob2, and proba., which may be manipulated to produce said performance score. 

26. The method of claim 25, wherein if SDj = 0, then conditional performance score = 0 otherwise 

ave, return! 



Tstati = 



SDl 



^revisioTisl 



; wherein if SD2, = 0, then conditional performance score = 0 otherwise 

ave, reUanZ 



Tstat2 = 



SDl ^ 



previsions! 



15 ; wherein if SD3, = 0, then conditional p^ormance score = 0 otherwise 

ave, returns • 

Tstat^ = 

SD3 



previsions3 



; wherein DFj = revisionsi - 1 ; DF2 = revisionsa - 1 ; and DF3 = revisionss - 1 



27. The method of claim 25, wherein said probabilities are determined according to a 
20 piedetennined look-up table using actual calculated values of: DFi, DF2, DF3, t-stati, t-stata, and t-sta^, 
unless: DFi > 100, in which case DFi is set to 100; DF2 > 100, in which case DF2 is set to 100; DF3 > 
100, in which case DFsis set to 100; t-stati > 20, in which case t-stati is set to 20; t-stat2> 20, in which 
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case t-statais set to 20; t-stats > 20, in which case t-stata is set to 20; t-stati < 0.01, in which case probi is 
set to 0; t-stat2< 0.01, in which case prob2is set to 0; or t-stata < 0.01, in which case proba is set to 0. 



28. The method of claim 25, wherein 

^ | [l-(.5+or-proM)] +[l-(.5+Qr-prQfe2)]+[l-(.5 + or-pro63)] 



5 cond _ performance _ score 



■=100 



wherein for upward revisions probi is subtracted from 0.5 if ave. retumi > 0, else probi is added to 0.5; 
wherein for upward revisions probj is subtracted from 0.5 if ave. retum2 > 0, else prob2 is added to 0.5; 
wherdn for upward revisions proba is subtracted fipom 0.5 if ave. retuma > 0, else probs is added to 0.5; 
wherein for downward revisions probi is subtracted from 0.5 if ave. retumi < 0, else probi is added to 
10 0.5; wherein for downward revisions prob2 is subtracted from 0.5 if ave. ietum2 < 0, else prob2 is added 
to 0.5; and wherein for downward revisions proba is subtracted from 0.5 if ave. return^ < 0, else prob^ is 
added to 0.5. 



29. A method of evaluating an analyst's performance by utilizing information pertaining to at least 
15 one revision made by the analyst involving at least one investment, said method conqndsiag the steps 
of: 

determining a first average return value (ave. retumi), second average return value (ave. 
retuma), and third average return value (ave. retuma) for the at least one revision, said first, second, and 
third average retum values corresponding respectively to an average rate of return on the at least one 
20 revision involving the investment for a first period of tims (timei), a second period of time (tim^, and 
a third period of time (times); 

calculating, in absolute terms, a first t-stat value (trstati) for ave. retumi, a second t-stat value 
(t-stat2) for ave. retum2, and a third t-stat value (t-stata) for ave. returns, said first, second, and third t- 
stat values calculated by utilisong ave. retumi, dve. retam2, ave. retuma, a first standard deviation (SDi), 
25 a second standard deviation (SDa), and a third standard deviation (SD3), a total number of revisions 
(revisionsi) occurring more than or equal to timei before said cA^uating, a total number of revisions 
(revisionsa) occurring more than or equal to timej before said evaluating, and a total number of 
revisions (revisionsa) occurring more than or equal to times before said evaluating; 

calculating a first degree of freedom (DFi) for ave. retumi, a second degree of freedom (DF2) 
30 for ave. retum2, and a third degree of freedom (DFs) for ave. returns; 

detennining a first probability (probi) for timei by utilizfaig t-stati and DPi, a second probability 
(probz) for timea by utilizing t-stat2 and DF2, and a third probability (proba) for times by utilizing t-stata 
andDFa; 

generating a raw conditional p^oimance score for the analyst by utilizmg probi, prob2, proba; 
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adding a modifier (adjustment) to the raw conditioiial performance score determined by 
utilizing revisionsi, revisions2, and revisionsa, thereby producing a conditional performance score 
(cond. performance score); . 

generating a small return penalty by subtracting a penalty from an average of return fiictors 
5 corresponding to timei , time2, and timea, wherem for upward revisions said penalty is 0 if ave. retuma is 
greater than 15%, else said penalty is equal to 15% minus ave. retuma, wherein for downward revisions 
said penalty is 0 if ave. retuma is less than -8%, else said penalty is equal to -8% minus ave. retuma, 
wherein said first pmod of time return factor is ten if ave. retumi is greater than ten, else said first 
period of time return factor is equal to a cube root of a product of 100 and ave. retumi, wherein said 
1 0 second period of time retum factor is ten if ave. ietnm2 is greater than ten, else said second period of 
time retum factor is equal to a cube root of a product of 1 00 and ave. retum2, and wh^:ein said third 
period of tune retum factor is ten if ave. retumais greater than ten, else said third period of time return 
factor is equal to a cube root of a product of 100 and ave . retuma ; and 

g^ierating a final perfoimance score ^)erfcHinance score) indicative of said analyst's 
15 perfoimance by adding said small retum p^alty to said conditional performance score. 

30. A system for evaluating an analyst's performance, said system coiiq)rising: 
a processor, 

a memory storing a computer program controlling operation of said processes, said program 
20 including instmctions for causing the processor to effect: 

utilizing information pertaining to at least one revision made by the analyst involving at least 
one investment, including an upward or downward change ia opinion of the analyst with regard to the 
at least one investment; 

calculating a conditional performance score mdicative of the analyst's performance relative to 
25 other analysts, said raw conditional performance score determined at least in part by considering a 
measure of variabihty of the analyst's performance, an average historical performance of the at least 
one investment following the at least one revision, a standard deviation of the at least one revision, a 
number of revisions made by the analyst, and a likelihood that the at least one revision will actually 
produce an expected result; and 
30 adjusting said conditional performance score according to a retum amount adjustment to 

produce a final performance score. 

31. The system of claim 30, wherein said average historical performance is calculated over three 
distinct periods of time, which conoprise a short period of tin^ which is approxinoately five days , an 

35 intmnediate pmod of time which is approxmiately twenty days, and a long period of time which is 
approximately sixty days. 
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32. The system of claim 30, wherein the final pof oimance score increases when a rate of return of 
the at least one investing increases and the revision is an upward revision, ox when a rate of return of 
the at least one investment decreases and the revisicm is a downward revision, and wherein the final 

S performance score decreases whea a rate of return of the at least one investment decreases and the 
revision is an upward revision, or when a rate of return of the at least one investment increases and the 
revision is a downward revision. 

33. The system of claim 30, wherein said program further comprises instructions to effect adjustmg 
10 said conditional performance score according to a modifier accentuating the numiber of revisions made 

by the analyst 

34. The system of claim 30, wherein said return amount adjustment conq)ri5es a small return 
peiudty reducing said final performance score for returns on said at least one investment less than a 

IS predetermined amount 

35. The system of claim 34, wherein said small return penalty is comprised of a difference between 
anaverageof a short period of time return factor, an intermediate period of time return factor, anda 
long pedod of tinoe return factor, and a penalty; wherein said penalty is equal to approximately 15% for 

20 upward revisions and approximately -8% for downward revisions minus a return value corresponding 
to the investment for said long period of time; and wherein each period of time return factor is a cube 
root of a return percentage over a corresponding period of time. 

36. The system of claim 34, wherein said smaU return penalty is ir[q>osed for small returns over a 
25 long period of time of approximately sixty days after said at least one revisioru 

37. The system of claim 34, wherein said small return penalty is generated by subtracting a penalty 
from an average of a fijst, second and third period of time return factor, wherein for upward revisions 
said penalty is 0 if an average return value corresponding to the investment for a long termp^od of 

30 time is greater than 15%, else said penalty is equal to 15% minus said average return value 

corresponding to the investment for a long term period of time; wherein for downward revisions said 
penalty is 0 if said average return value corresponding to the investment for a Icmg term period of time 
is less than -8%, else said penalty is equal to -8% minus said average retum value corresponding to the 
investm^t f oa: a long term period of time; wherem said first pedod of time retum factor is ten if an 

35 average retum over said first period of time is greater than ten, else said first period of time retum 

factor is equal to a cube root of a product of 100 and said average retum over said first period of time; 
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wheiein said second pericxl of time return factor is ten if an average return over said sbcond period of 
tune is greater than ten, else said second period of time return factor is equal to a cube root of a product 
of 100 and said average return over said second pmod of time; and wherein said third period of time 
return factor is ten if an average return over said third period of tune is greater than ten, else said third 
5 p^od of tuxe return &ctor is equal to a cube root of a product of 100 and said average return over said 
third period of time. 

8. A system for evaluating an analyst's performance, said system conqnising: 

a processor, 

10 a memory storing a conq>uter program controlling operation of said processor, 
said program including instructions for causing the processor to effect 

utilizing information pertaining to at least one inward or downward revision including an 
upward or downward change in opinion of the anal3rst with regard to the at least one investoient; 
calculating a p^ormance score indicative of the analyst's performance relative to other 

IS analysts, said perfonnance score determined at least in part by considering a measure of variability of 
the analyst's performance, an average historical p^onnance of the at least one investment following 
the at least one upward or downward revision, a standard deviation of the at least one upward or 
downward revision, a number of upward or downward revisions made by the analyst, and a likelihood 
that the at least one upward or downward revision will actually produce an expected result; and 

20 comparing the analyst's performance score against performance scores of other analysts to 

produce at least one of an upward, downward or combined revision ranking. 

39. The system of claim 38, wherein said program further coirq>rises instructions to effect adjustmg 
said performance score according to a modifier accentuating the number of revisions made by the 

25 analyst 

40. The system of claim 38, wherein said perfonnance score increases when a rate of return of the 
at least one investment increases and the revision is an upward revision, or when a rate of return of the 
at least one investment decreases and the revision is a downward revision, and wherein said 

30 performance score decreases when a rate of return of the at least one investment decreases and the 

revision is an upward revision, or when a rate of return of the at least one investment increases and the 
revision is a downward revision. 

41. The system of claim 38, wherein said calculating a perfonnance score conqmses: 

35 determining a first average return value (ave. retumi), second average return value (ave. 

retum2), and third average return value (ave. returns) for the at least one revision, said first, second, and 
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third average rcttim values conespondiug respectively to an average rate of return oa the at least one 
revision involving the investm^t for a first period of tune (tiinei), a second period of tune (tinaea), and 
a third period of time (times); 

calculating, in absolute tenm^ a first t-stat value (t-stati) for said first average retum value, a 
second t-stat value (t-stat2) for said second average retum value, and a third t-stat value (t-stats) for said 
third average retum value, said first, second, and third t-stat values calculated by utilizing said first, 
second, and third average retum values, a fibrst standard deviation (SDi), a second standard deviation 
(SD2), and a (bird standard deviation (SDa), a total nuniber of revisions (revisionsi) occurring more than 
or equal to the first period of time before said evaluating, a total number of revisions (revisionS2) 
occurring more than or equal to the second p^od of time before said evaluating, and a total number of 
revisions (revisionss) occurring moro than or equal to the tiiird period of time before said evaluating; 

calculatmg a first degree of freedom (DFO for said first average retum value, a second degree 
of fi:eedom (DP^ for said second average retum value, and a third degree of fisedom (DF3) for said 
third average retum value; 

deteruuning a first probability (probi) for said first period of time by utilizing said first t-stat 
value and said first degree of fieedom, a second probability (proba) for said second period of time by 
utilizing said second t-^tat value and said second degree of fireedom, and a third probability (proba) for 
said third period of time by utilizing said third t-stat value and said third degree of fieedom; and 

generatiag a conditional perfonnance score (cond. performance score) for the analyst by 
utilizing probi, probz, and probs,, which ntiay be manipulated to produce said performance score. 

42. The system of claim 41, wherein if SDi = 0, then conditional poibrmance score = 0 otherwise 



ave. retuml 



Tstati = 



SDI 




; wherein if SD2, = 0, then conditional performance score =:Ootberwise 



ave, retuml 



Tstat2 = 



SD2 




; wherein if SD3, = 0, then conditional performance score =0 otherwise 

ave^ returns 
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Tstat^ 



SD3 ^ 



•^JrevisionsS 



; wherein DFi = levisionsi - 1; DF2= revisionS2 - 1; and DF3= revisionss - 1 



10 



43. The system of claim 41, wherein said probabilities are determined according to a predetermined 
look-up table using actual calculated values ofi DFi, DF2, DF3, t-stati, t'Stat2j and t-stRt^y unless^ DFi > 
100. in which case DFi is set to 100; DFj > 100, m which case DF2 is set to 100; DF3 > 100, in which 
case DF3 is set to 100; t-stati > 20, in which case t-stati is set to 20; t-stat2 > 20, in which case t-stat2 is 
set to 20; t-stat3> 20, m which case t-statsis set to 20; t-stati < 0.01, in which case probi is set to 0; t- 
stat2< 0.01, in which case prob2is set to 0; or t-stat3 < 0.01, in which case probsis set to 0. 



44. The system of claim 41, whereui 



cond _ performance _ score 



_ I [1 - (.5 + or - profrl)] + [l - (.5 + <yr - probl)] + [l - (.5 + or - prob3)] 



100 



wherein for upward revisions probi is subtracted ftom 0.5 if ave. returni > 0, else probi is added to 0.5; 
wherein for upward revisions prob2 is subtracted from 0.5 if ave. retum2 > 0, else prob2 is added to 0.5; 
15 wherein for upward revisions probs is subtracted firom 0.5 if ave. retum3 > 0, else prob^ is added to 0.5; 
wherein for downward revisions probi is subtracted fix>m 0.5 if ave. returui < 0, else probi is added to 
0.5; wherein for downward revisions prob2 is subtracted ftom 0.5 if ave. retum2 < 0, else prob2 is added 
to 0.5; and wherein for downward revisions probs is subtracted from 0.5 if ave. returns < 0, else probs is 
added to 0.5. 

20 

45. A system for evaluating an analyst^s performance, said system conq)rising: 

means for utilizmg information pertaining to at least one revision made by the analyst involving 
at least one investment, including an upward or downward change in qpmion of the analyst with regard 
to the at least one investn^t; 

25 means for calculating a conditional performance score indicative of the analyst's performance 

relative to other analysts, said raw conditional performance score determined at least in part by 
considering a measure of variability of the analyst's performance, an average historical performance of 
the at least one investment following the at least one revision, a standard deviation of the at least one 
revision, a number of revisions made by the analyst, and a likelihood that the at least one revision will 

30 actually produce an e^ipected result; and 
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means for adjusting said conditional performance score according to a return amount 
adjustment to produce a final performance score. 

46. The system of claim 45, wherein said average historical performance is calculated over three 
5 distinct periods of time, which conqnise a short period of time which is approximately five days, an 

intermediate period of time which is approximately twenty days, and a long period of time which is 
approximately six^ days. 

47. The system of claim 45, wherein the final perfoimance score increases when a rate of return of 
10 the at least one investment increases and the revision is an upward revision, or when a rate of return of 

the at least one investment decreases and the revision is a downward revision, and wherein the final 
performance score decreases when a rate of return of the at least one investn^nt decreases and the 
revision is an upward revision, or when a rate of return of the at least one iavestment increases and the 
revision is a downward revision. 

15 

48. The system of claim 45, further conq)ri5ing means for adjusting said conditional p^ormance 
score according to a modifier accentuating the number of revisions made by the analyst 

49. The system of claim 45, wherein said return amount adjustment conqmses a small return 
20 penalty rediKnng said final performance score for returns on said at least one investment less than a 

predetermined amount 

50. The system of claim 49, wherein said small return penalty is conqirised of a difference between 
an average of a short period of time return factor, an intermediate period of time return factor, and a 

25 long period of time return £actor, and a penalty; wherdn said penalty is equal to approximately 15% for 
upward revisions and ^proxinoately -8% for downward revisions minus a return value corresponding 
to the investment for said long period of time; and wherein each period of time return factor is a cube 
root of a return percentage over a corresponding period of time. 

30 51. The system of claim 49, wherein said smaU return praialty is inq>osed for small returns over a 
long period of time of approximately sixty days after said at least one revision. 

52. The system of claim 49, wherein said small retum penalty is generated by subtracting a penalty 
firom an average of a first, second and third pmod of time retum i^tor, wherein for upward revisions 
35 said p^ialty is 0 if an average retum value corresponding to the investment for a long term period of 
time is greata: than 15%, else said penalty is equal to 15% minus said average retum value 
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conesponding to the investment for a long tenn period of time; wherein for downward revisions said 
penalty is 0 if said average return value corresponding to the investment for a long term period of time 
is less than -8%, else said penalty is equal to -8% minus said average retum value corresponding to the 
investment for a long term period of time; wherein said first period of time retum factor is ten if an 
5 average retum over said first period of time is greater than ten, else said ficrst period of time retum 
factor is equal to a cube root of a product of 100 and said average return over said first period of time; 
wherein said second period of time retum factor is ten if an average return over said second period of 
time is greater than ten, else said second period of time retum factor is equal to a cube root of a product 
of 100 and said average retum over said second period of time; and wherein said third period of time 
10 return factor is ten if an average retum over said third p^od of tiin& is greater than tea, else said third 
period of time retum factor is equal to a cube root of a product of 100 and said average retum over said 
third period of time. 

53. A system for evaluating an analyst's performance, said system conqprising: 

IS roeans for u tilizing information pertaining to at least one upward or downward revision 

including an upward or downward change in opinion of the analyst with regard to the at least one 
investment; 

means for calculating a performance score indicative of the analyst's performance relative to 
other analysts, said performance score determined at least in part by considering a measure of 
20 variability of the analyst's performance, an average historical performance of the at least one 

investment following the at least one upward or downward revision, a standard deviation of the at least 
one upward or downward revision, a number of upward or downward revisions made by the analyst, 
and a lilcelihood that the at least one upward or downward revision wiU actually produce an expected 
result; and 

2S means for conq)aring the analyst' s performance score against performance scores of other 

analysts to produce at least one of an upward, downward or combined revision ranldng. 

54. Hie system of claim S3, further conq)rising means for adjusting said performance score 
according to a modifier acc^tuating the number of revisions made by the analyst 

30 

55. The system of claim 53, wherein said p^ormance score increases when a rate of retum of the 
at least one investment increases and the revision is an upward revision, or when a rate of retum of the 
at least one investmimt decreases and the revision is a downward revision, and wherein said 
performance score decreases when a rate of retum of the at least one investment decreases and the 

3S revision is an upward revision, or when a rate of retum of the at least one investnient increases and the 
revision is a downward revision. 
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10 



15 



20 



25 



56. The system of claim 53, wherein said calcuiatmg a perfannance score coHqnises: 
deteninDiDg a first average return value (ave. retomi), second average retum value (ave. 

retum2), and third average return value (ave. returns) for the at least one revision, said first, second, and 
third average retum values corresponding respectively to an average rate of retum on the at least one 
revision involving the investn^nt for a first period of time (timei), a second period of time (tunea), and 
a third period of time (timea) ; 

calculating, in absolute temis, a first t*stat value (t-statO for said first average retum value, a 
second t-stat value (t-stata) for said second average retum value, and a third t-stat value (t-stata) for said 
third average retum value, said first, second, and third t-stat values calculated by utilizmg said first, 
second, and third average retum values, a first standard deviation (SDi), a second standard deviation 
(SDz), and a ttiird standard deviation (SD3), a total number of revisions (revisions}) occurring more than 
or equal to the first period of time before said evaluating, a total number of revisions (revisions^) 
occurring nK>re than or equal to the second period of tin^ before said evaluating, and a total number of 
revisions (revisionsa) occurring more than or equal to the third period of time before said evaluating; 

calculating a first degree of fipeedom (DFi) for said first average retum value, a second degree 
of freedom (DF2) for said second average return value, and a third degree of fireedom (DFa) for said 
third average retum value; 

detmnining a first probability (probi) for said first period of time by utilizing said first t-stat 
value and said first degree of fieedom, a second probability (prob2) for said second period of time by 
utili2dng said second t-stat value and said second degree of fiieedom, and a third probability (proba) for 
said third period of time by utilizing said third t-stat value and said third degree of fneedom; and 

generating a conditional performance score (cond. performance score) for the analyst by 
utilizing prob], prob2, and proba,, which may be manipulated to produce said performance score. 

57. The system of claim 56, wherein if SDi = 0, then conditional performance score = 0 otherwise 

ave. retuml 



Tstatx = 



SDI 



^revisionsl 



; wherein if SDz, = 0, then conditional p^onnance score = 0 otherwise 

ave. retum2 

Tstat2 = 
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SD2 



previsions! j 



; wherein if SD3, == 0, then conditional perfonnance score = 0 otherwise 

ave, returns 



Tstat^ = 



SD3 




; wherein DFi = levisionsi - 1; DF2 = tevisions2 - 1; and DF3= revisionsa - 1 

5 

58. The system of claim 56, wherein said probabilities are detemxined according to a predetemnned 
look-up table using actual calculated values ofc DFi, DF2, DF3, t-statj, t-stat2, and t-statj, unless: DFi > 
100, in which case DFj is set to 100; DF2 > 100, in which case DF2 is set to 100; DF3 > 100, m which 
case DFsis set to 100; t-stati > 20, in which case t-stati is set to 20; t-stat2> 20, in which case t-stat2is 

10 set to 20; t-stata > 20, in which case t-stats is set to 20; t-stati < 0.01, in which case probi is set to 0; t- 
stat2< 0.01, in which case prob2is set to 0; or t-stat3< 0.01, in which case probais set to 0. 

59. The system of claim 56, wherein 



15 wherein for upward revisions probi is subtracted from 0.5 if ave. return] > 0, else probi is added to 0.5; 

wherein for upward revisions prob2 is subtracted from 0.5 if ave. retum2 > 0, else prob2 is added to 0.5; 

wherein for upward revisions proba is subtracted from 0.5 if ave. returns > 0, else probs is added to 0.5; 

wherein for downward revisions prohi is subtracted from 0.5 if ave. retumi < 0, else probi is added to 

0.5; whocein for downward revisions prob2 is subtracted from 0.5 if ave. retum2 < 0, else prob2 is added 
20 to 0.5; and wherein for downward revisions probs is subtracted from 0.5 if ave. retuma < 0, else probs is 

added to 0.5. 

60. A conq>uter data signal embodied in a carrier wave, said signal bearing instructions for causmg 
a conq)uter system to evaluate an analyst's performance, said mstructions conqirising: 
25 utilizing information pertainmg to at least one revision made by the analyst involving at least 

one investment, including an upward or downward change m (pinion of the analyst with regard to the 
at least one mvestment; 



cond _ performance^ score 



[1 - (.5 + or - probi)] + [l - -f or - prohl)] + [l - ( J + or - prob3)] 
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calculating a conditional perfonnance score indicative of the analyst's perfonnance relative to 
oth^ analysts, said raw conditional perfonnance score determined at least in part by considering a 
measure of variability of the analyst's performance, an av^age historical perfonnance of the at least 
one investment following the at least one revision, a standard deviation of the at least one revision, a 
S number of revisions made by the analyst, and a likelihood that the at least one revision will actually 
produce an expected result; and 

adjusting said conditional p^ormance score according to a return amount adjustment to 
produce a final performance score. 

10 61. The signal of claim 60, wherein the final performance score increases when a rate of return of 
the at least one investment iacreases and the revision is an upward revision, or when a rate of return of 
the at least one investment decreases and the revision is a downward revision, and wherein the final 
performance score decreases when a rate of return of the at least one investment decreases and the 
revision is an upward revision, or when a rate of return of the at least one investment increases and the 

15 revision is a downward revisioiL 

62. The signal of claim 60, wherein said return amount adjustment conqnrises a small return penalty 
reducing said final performance score for returns on said at least one investment less than a 
predetomined amount 

20 

63. The signal of claim 62, wherein said small return penalty is coir^rised of a difference between 
an average of a short period of time return factor, an mtermediate period of time return factor, and a 
long period of time return factor, and apenalty; wherein said penalty is equal to approximately 15% for 
upward revisions and approximately for downward revisions minus a return value corresponding 

25 to the investment for said long period of time; and wherein each period of time return factor is a cube 
root of a return percentage over a corresponding pedod of time. 

64. The signal of claim 62, wherein said small return penalty is generated by subtracting a penalty 
from an average of a first, second and third period of time return factor, wherein for upward revisions 

30 said penalty is 0 if an average return value corresponding to the investnoent far a long term period of 
time is greater than 15%, else said p^ialty is equal to 15% minus said average return value 
corresponding to the investment for a long term period of time; wherein for downward revisions said 
penalty is 0 if said average letum value corresponding to the investment for a long term period of time 
is less than -8%, else said p^ialty is equal to -8% minus said average return value corresponding to the 

35 investment for a long term period of time; wherein said first period of time return factor is ten if an 
average return over said first period of time is greater than ten, else said first period of time return 
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factor is equal to a cube root of a product of 100 and said av^^age letum over said j5rst period of time; 
wherein said second period of time return factor is ten if an average return over said second period of 
time is greater tban ten, else said second period of time return &ctor is equal to a cube root of a product 
of 100 and said average return over said second period of time; and wherein said third pmod of time 
S return factor is ten if an average retum over said third p^od of time is greater than ten, else said third 
period of time retum &ctor is equal to a cube root of a product of 100 and said average retum over said 
third p^od of time. 

65. A conq>uter data signal embodied in a carrier wave, said signal bearing instructions for causing 
10 a conq>ut^ system to evaluate an analyst' s performance, said instructions coir^sing: 

utilizing information pertaining to at least one iq>ward or downward revision including an 
upward or downward change in opinion of die analyst with regard to the at least one investment; 

calculating a performance score indicative of the analyst's performance relative to other 
analysts, said performance score determined at least in part by considering a measure of variability of 
IS the analyst's performance, an av^ge historical performance of the at least one investment following 
the at least one upward or downward revision, a standard deviation of the at least one upward or 
downward revision, a number of upward or downward revisions made by the analyst, and a likelihood 
that the at least one upward or downward revision will actually produce an expected result; and 

conq>aiing the analyst's performance score against performance scores of olher analysts to 
20 produce at least one of an upward, downward or combined revision ranking. 

66. The signal of claim 65, further cono^rising instructions for adjusting said performance score 
according to a modifier accentuating the number of revisions made by the analyst 

25 67. The signal of claim 65, wherein said calculating a performance score conqnises: 

determining a first average retum value (ave. retumO. second average retum value (ave. 
retum2), and third average retum value (ave. returns) for the at least one revision, said first, second, and 
third average retum values corresponding respectively to an average rate of retum on the at least one 
revision involving the investment for a first period of time (timei), a second period of time (time2), and 

30 a third period of time (times); 

calculating, in absolute terms, a first t-stat value (t-stati) for said first av^ge retum value, a 
second t-stat value (t-stat2) for said second average retum value, and a third t-stat value (t-^tata) fox said 
third average retum value, said first, second, and third t-^tat values calculated by utilizing said first, 
second, and third average return values, a first standard deviation (SDi), a second standard deviation 

35 (SD2), and a third standard deviation (SD3), a total number of revisions (revisionsi) occurring more than 
or equal to the first period of time before said evaluating, a total numb^ of revisions (revisionsz) 
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occmring more than or equal to the second period of time before said evaluating, and a total number of 
revisions (revisionsa) occulting more than or equal to the third period of time before said evaluating; 

calculating a first degree of fieedom (DFi) for said first average return value, a second degree 
of fteedom (DF2) for said second average return value, and a third degree of fteedomCDFa) for said 
5 third average return value; 

determining a first probability (probi) for said first period of time by utilizing said first t-stat 
value and said first degree of fireedom, a second probability (proba) for said second period of time by 
utilizing said second t-stat value and said second degcee of fireedom, and a third probability (proba) for 
said third period of time by utilizing said third t-stat value and said third degree of freedom; and 
10 generating a conditional performance score (cond. performance score) for the analyst by 

utilizing probi, probj, and probs., which may be manipulated to produce said performance score. 

68. A conq>uter readable medium storing instmctions executable by a conq)uter, the instructions for 
instructing the conf>uter to effect evaluating an analyst's performance, said instructions comprising: 

15 utilizing information pertaining to at least one revision made by the analyst involving at least 

one investment, including an upward or downward change in opinion of the analyst with regard to the 
at least one investment; 

calculating a conditional performance score indicative of the analyst's performance relative to 
oth^ analysts, said mw conditional performance score determined at least in part by considering a 

20 measure of variability of the analyst's performance, an avraage historical performance of the at least 
one investment following the at least one revision, a standard deviation of the at least one revision, a 
number of revisions made by the analyst, and a likelihood that the at least one revision will actually 
produce an e^)ected result; and 

adjusting said conditional performance score according to a return amount adjustment to 

25 produce a final performance score. 

69. The conq)Uter readable medium of claim 68, wherein the final performance score increases 
when a rate of return of the at least CMie investDoent increases and the revision is an upward revision, or 
when a rale of return of the at least one investooent decreases and the revision is a downward revision, 

30 and wherein the final performance score decreases when a rate of return of the at least one investnoent 
decreases and the revision is an upward revision, or when a rate of return of the at least one investment 
increases and the revision is a downward revision. 

70. The computer readable medium of claim 68, wherein said return amount adjustment conqnises 
35 a small return penalty reducing said final performance score for returns on said at least one investment 

less than a predetermined amount 
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71. The computer readable medium of claim 70, \vherein said small return penalty is coiif)ri5ed of 
a difib^nce between an average of a short period of time return factor, an intermediate period of time 
return factor, and a long period of time return &ctor, and a penalty; wherein said penalty is equal to 

S approximately 13% for upward revisions and approximately -8% for downward revisions minus a 
return value corresponding to the investment for said long period of time; and wherein each period of 
time return factor is a cube root of a return percentage over a corresponding period of time. 

72. The computer readable medium of claim 70, wherein said small return penalty is genmted by 
10 subtracting a penalty from an average of a first, second and third period of time return factor; wherein 

for iqpward revisions said penalty is 0 if an average return value corresponding to the investn^nt for a 
long term period of time is greater than 1S%, else said penalty is equal to 15% minus said average 
return value corresponding to the investment for a long term period of time; wherein for downward 
revisions said penalty is 0 if said average return value corresponding to the investment for a long term 

15 period of time is less than -8%, else said penalty is equal to -8% minus said average return value 

corresponding to the investment for a long term period of time; wherein said first pedod of time return 
factor is ten if an average return over said first pmod of time is greater than ten, else said Sist period of 
time return ^tor is equal to a cube root of a product of 100 and said average return over said first 
period of tune; wherein said second period of time return factor is ten if an average return over said 

20 second period of time is greater than ten, else said second period of tin^ retum factor is equal to a cube 
root of a product of 100 and said average retum ov^ said second period of time; and wh^in said third 
p^od of time retum &ctor is ten if an average retum over said third pmod of time is greater than ten, 
else said third period of time retum factor is equal to a cube root of a product of 100 and said average 
retum over said third p^od of time. 

25 

73. A computer readable medium storing instructions executable by a computer, the instmctions for 
instmcting the conq)uter to effect evaluating an analyst's performance, said instructions corqprising: 

utilizing information pertaining to at least one upward or downward revision including an 
upward or downward change in opinion of the analyst with regard to the at least one investment; 

30 calculating a performance score indicative of the analyst's perfomoance relative to odier 

analysts, said performance score determined at least in part by considering a measure of variability of 
the analyst's performance, an average historical performance of the at least one investntent following 
the at least one upward or downward revision, a standard deviation of the at least one upward or 
downward revision, a number of upward or downward revisions made by the analyst, and a likelihood 

35 that the at least one upward or downward revision will actually produce an expected result; and 
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conq>aimg tbe analyst's performance score against performance scores of other analysts to 
produce at least one of an upward, downward or combined revision ranking. 

74. The con^uter readable medium of claim 73, further comprising adjusting said p^ormance 
3 score according to a modifi^ accentuating the number of revisions made by the analyst 

75. The conq)utex readable medium of claim 73, wherein said calculating a performance score 
comprises: 

determining a first average return value (ave. retumO, second average return value (ave. 

10 retum2), and third average return value (ave. retuma) for the at least one revision, said first, second, and 
third average return values corresponding respectively to an average rate of return on the at least one 
revision involving the investment for a first period of time (timei), a second period of time (timea), and 
a third period of time (times); 

calculating, in absolute temts^ a first t-stat value (t-stati) for said first average return value, a 

IS second t-stat value (t-stata) for said second average return value, and a third t-stat value (t-stats) for said 
third average return value, said first, second, and third t-stat values calculated by utilizing said first, 
second, and third average return values, a first standard deviation (SDi), a second standard deviation 
(SD2), and a diird standard deviation (SD3), a total number of revisions (revisionsi) occurring more than 
or equal to the first period of time before said evaluating, a total number of revisions (revisionsa) 

20 occurring more than or equal to the second period of time before said evaluating, and a total number of 
revisions (revisionsa) occurring more than or equal to the third period of time before said evaluating; 

calculating a first degree of freedom (DFi) for said first average return value, a second degree 
of freedom (DF2) for said second average return value, and a third degree of fipeedom (DFs) for said 
third average retum value; 

25 determining a first probability (probi) for said first period of time by utilizing said fiurst t-stat 

value and said first degree of freedom, a second probability (proba) for said second pmod of time by 
utilizing said second t-stat value and said second degree of freedom, and a third probability (probs) for 
said third period of time by utilizing said third t-stat value and said third degree of freedom; and 
generating a conditional performance score (cond performance score) for the analyst by 

30 utilizing probi, prob2, and prob^,, which may be manipulated to produce said performance score. 

76. A method of evaluating an analyst' s performance, said method comprising: 

a step for utilizing information pertaining to at least one revision made by the analyst involving 
at least one investment, including an upward pr downward change in opinion of the analyst with regard 
35 to the at least one investment; 
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a step for calculating a conditional perfoimance scoie indicative of the analyst's perfonnance 
relative to other analysts, said raw conditional peifotmance score det^mined at least in part by 
considering a measure of variability of the analyst's perfonnance, an average historical perfonnance of 
the at least one investment f oUowing the at least one revision, a standard deviation of the at least one 
5 revision, a number of revisions made by the analyst, and a liloelihood that the at least one revision will 
actually produce an expected result; and 

a step for adjusting said conditional perfonnance score according to a return amount adjustment 
to produce a final performance score. 

10 77. A method of evaluating an analyst's performance, said method coiiq>rising: 

a step for utilizing information pertaining to at least one iq)ward or downward revision 
including an upward or downward change in opinion of the analyst with regard to the at least one 
investment; 

a step for calculating a performance score indicative of the analyst's performance relative to 
IS other analysts, said performance score determined at least m part by consid^ing a measure of 
variability of the analyst's performance, an average historical performance of the at least one 
investment following the at least one upward or downward revision, a standard deviation of the at least 
one upward or downward revision, a number of upward or downward revisions made by the analyst, 
and a likelihood that the at least one upward or downward revision will actually produce an expected 
20 result; and 

a step for comparing the analyst's perfonnance score against performance scores of other 
analysts to produce at least one of an upward, downward or combined revision ranking. 
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